Confluent
MARCH 30, 2021
At the heart of Apache Kafka® sits the log—a simple data structure that uses sequential operations that work symbiotically with the underlying hardware. Efficient disk buffering and CPU cache usage, […].
Data Engineering Podcast
MARCH 29, 2021
Summary Data quality is on the top of everyone’s mind recently, but getting it right is as challenging as ever. One of the contributing factors is the number of people who are involved in the process and the potential impact on the business if something goes wrong. In this episode Maarten Masschelein and Tom Baeyens share the work they are doing at Soda to bring everyone on board to make your data clean and reliable.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Start Data Engineering
MARCH 27, 2021
Event driven pipelines Lambda function to trigger spark jobs Setup and run Monitoring and logging Teardown Conclusion Further reading References Event driven pipelines Event driven systems represent a software design pattern where a logic is executed in response to an event. This event can be a file creation on S3, a new database row, API call, etc.
Cloudera
MARCH 31, 2021
CDP Public Cloud is now available on Google Cloud. The addition of support for Google Cloud enables Cloudera to deliver on its promise to offer its enterprise data platform at a global scale. CDP Public Cloud is already available on Amazon Web Services and Microsoft Azure. With the addition of Google Cloud, we deliver on our vision of providing a hybrid and multi-cloud architecture to support our customer’s analytics needs regardless of deployment platform. .
Advertisement
Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?
Confluent
MARCH 29, 2021
Self-managing a highly scalable distributed system with Apache Kafka® at its core is not an easy feat. That’s why operators prefer tooling such as Confluent Control Center for administering and […].
Monte Carlo
APRIL 1, 2021
Over the past few years, data lakes have emerged as a must-have for the modern data stack. But while the technologies powering our access and analysis of data have matured, the mechanics behind understanding this data in a distributed environment have lagged behind. Here’s where data catalogs fall short and how data discovery platforms and tools can help ensure your data lake doesn’t turn into a data swamp.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Cloudera
APRIL 2, 2021
Some of the most forward-operational elements of the United States federal government are making strides in leveraging data through hybrid cloud environments—and they’re constantly evaluating progress and recalibrating their approaches along the way. At agencies including the Army and the State Department, work is well underway to find ways of employing emerging technologies that build on cloud services and data optimization to realize new levels of effectiveness.
Grouparoo
MARCH 30, 2021
Teams are centralizing their data in their data warehouse by loading data in and transforming it as necessary. Increasingly, we are seeing teams turn to dbt to do this transforming. The idea is to write *.sql files that, when run in the right order, create useful rollup tables or materialized views of the data. We've been asked by teams using dbt how Grouparoo can then sync their data to their cloud-based apps.
Afterpay Tech
MARCH 29, 2021
Photo by Yancy Min on Unsplash By: Alex Rosenzweig Overview Helping our engineers build amazing products that are worthy of our customer’s trust is the job of our product security team. One of the tools in the product security team’s arsenal is our code scanning platform which we lovingly call “Intersect” Effective code scanning is a core building block of a modern security program.
DataKitchen
APRIL 1, 2021
Building the Backend host Travis Lawrence interviews DataKitchen CEO Chris Bergh on three value bombs: (1) DataOps is not just DevOps for data; (2) Architect for change; & (3) CDOs should be on the offense. The post DataOps Is Not Just DevOps for Data first appeared on DataKitchen.
Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin
As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.
Teradata
MARCH 28, 2021
At Teradata, we're standing together with AAPI communities & commit to take action. It is our responsibility to create a change for the future - a world where everyone experiences safety & equality.
Rock the JVM
APRIL 1, 2021
This quick article demonstrates how Scala 3's given instances integrate seamlessly with Scala 2's implicits
ProjectPro
APRIL 1, 2021
Over the last decade, there has been an explosion of interest in data science careers, and the number of people looking to make a career in data science. The COVID-19 pandemic crisis caused millions to lose their jobs and forced people to rethink career transition. One question that our Project Advisors often get from nearly everyone interested in pursuing a data science career – whether they are just getting started or looking to transition into the most in-demand data science job market
DataKitchen
APRIL 1, 2021
Customer Insights Leader podcast host Paul Laughlin interviews DataKitchen CEO Chris Bergh about his career & passion for DataOps, how DataOps teams can measure success, & skills analysts should develop to succeed with DataOps. The post A Career & Passion for DataOps first appeared on DataKitchen.
Speaker: Nikhil Joshi, Founder & President of Snic Solutions
Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.
Teradata
MARCH 30, 2021
Untimely & inaccurate financial analysis can lead to incorrect & costly business decisions. Users want accurate information now and automation is a key driver.
Rockset
MARCH 31, 2021
Ritual is a health-meets-technology company reimagining the products we use every day, starting with the multivitamin. With an in-house team of scientists and researchers, Ritual invests in creating high-quality, science-backed multivitamins formulated to help fill common nutrient gaps in diets at different life stages and making those nutrients readily traceable though the first visible supply chain of its kind.* Taking an evidence-based approach, Ritual has designed multivitamins with key high
ProjectPro
MARCH 29, 2021
‘Man and machine together can be better than the human’ All thanks to deep learning frameworks like PyTorch, Tensorflow, Keras, Caffe, and DeepLearning4j for making machines learn like humans with special brain-like architectures known as Neural Networks. The war of deep learning frameworks has two prominent competitors- PyTorch vs Tensorflow because the other frameworks have not yet been adopted widely.
DataKitchen
MARCH 30, 2021
The post How the Open Edge Is Driving Digital Transformation first appeared on DataKitchen.
Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage
When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.
Rock the JVM
MARCH 27, 2021
Learn how to organize code, messages, domains, and logic in an Akka application with Scala
Preset
MARCH 31, 2021
Apache ECharts is a top open-source data visualization framework. In this post, we'll explore why the Apache Superset™ community is betting on ECharts.
Cloudera
MARCH 29, 2021
In October 2020, Cloudera made a strategic acquisition of a company called Eventador. This was primarily to augment our streaming capabilities within Cloudera DataFlow. Eventador was adept at simplifying the process of building streaming applications. Their flagship product, SQL Stream Builder, made access to real-time data streams easily possible with just SQL (Structured Query Language).
DataKitchen
MARCH 29, 2021
The post Improving Collaboration with a DataOps Platform first appeared on DataKitchen.
Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network
In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.
Monte Carlo
APRIL 1, 2021
We sat down with C indi Howson , Chief Data Strategy Officer at T houghtSpot , the leading search and AI-driven analytics platform, for a wide-ranging conversation about her daily work, common challenges organizations face on the road to data democratization, and diversity in data science. Over the past few decades, the world of data analytics has undergone transformation from a siloed entity to a cross-functional powerhouse.
Teradata
APRIL 2, 2021
The concepts and processes surrounding self-service analytics sound easy. So why does the illusion of self-service rarely translate to reality? Find out more.
DataKitchen
APRIL 1, 2021
DATA MASTERS hosts Mark Marinelli & Nate Nelson interview DataKitchen CEO Chris Bergh. The post An Introduction to DataOps first appeared on DataKitchen.
DataKitchen
APRIL 2, 2021
The post The Intersection of Data Democratization and Security first appeared on DataKitchen.
Speaker: Evelyn Chou
Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.
Expert insights. Personalized for you.
145 
Let's personalize your content