Monte Carlo
DECEMBER 18, 2024
As we turn the corner into 2025, were excited to announce that for the 7th quarter in a row, Monte Carlo has been named G2s #1 Data Observability Platform, as well as #1 in the Data Quality category. This recognition never gets old because G2 bases their rankings on feedback and insights from real customers who work in these tools every day to add value to their business.
Precisely
DECEMBER 18, 2024
Key Takeaways : Poor address data can lead to missed deliveries, incorrect customer information, and wasted resources negatively impacting overall customer satisfaction, operational efficiency, and profitability. Correcting bad addresses is just the beginning you need to then connect those clean addresses to other valuable data points to unlock real value.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Tweag
DECEMBER 18, 2024
We all know how it feels: staring at the terminal while your development server starts up, or watching your CI/CD pipeline crawl through yet another build process. For many React developers using Create React App (CRA), this waiting game has become an unwanted part of the daily routine. While CRA has been the go-to build tool for React applications for years, its aging architecture is increasingly becoming a bottleneck for developer productivity.
Striim
DECEMBER 18, 2024
In 2024 , the global airline industry is projected to spend $291 billion on fuel, making it one of the most significant expenses for airlines. Inefficient fuel management not only drives up operational costs but also hampers environmental targets. However, optimizing fuel usage is complex, often hindered by limited real-time monitoring, which can lead to unnecessary waste due to inefficient routes, weather adjustments, excess weight, and outdated practices.
Speaker: Tamara Fingerlin, Developer Advocate
Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.
Cloudyard
DECEMBER 18, 2024
Read Time: 2 Minute, 38 Second In data-driven organizations, File Archival in Snowflake: A Snowpark-Powered Solutionhas become a game-changer. Handling feed files in data pipelines is a critical task for many organizations. These files, often stored in stages such as Amazon S3 or Snowflake internal stages, are the backbone of data ingestion workflows.
Start Data Engineering
DECEMBER 18, 2024
1. Introduction 2. Ways to reuse seed data across multiple dbt projects 2.1. Code setup 2.1.1. Prerequisites 2.1.2. Setup project environment 2.2. Turn the source repo into a dbt package 2.2.1. Define package version in dbt_project.yml 2.2.2. Store your package for other dbt projects to reference 2.3. Use project dependencies (dbt enterprise only) 2.4.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
|
KDnuggets
DECEMBER 18, 2024
Writing Python code thats clean and easy to understand isnt just for experts — learn how to avoid common pitfalls and write like a pro from the start!
databricks
DECEMBER 18, 2024
Czech savings bank esk spoitelna , a division of Austrias Erste Group , recently collaborated with AI solution builder DataSentics to explore the.
KDnuggets
DECEMBER 18, 2024
Build a strong data science portfolio by showcasing technical skills, working on real-world projects, staying active on LinkedIn, and leveraging platforms like GitHub and Kaggle to demonstrate your expertise.
Confluent
DECEMBER 18, 2024
Catch up on AI Days Keynote; AI Accelerator launch; panel discussion with Anthropic, AWS, MongoDB, Reworkd, and Confluent; GenAI RAG workshops; and a hackathon with a GenAI app showcase. Watch the full livestream on demand.
Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage
There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.
KDnuggets
DECEMBER 18, 2024
See how to revolutionize how you bring stories to life with AI.
Hevo
DECEMBER 18, 2024
With the year 2024 nearing its end, it is time to examine the significant trends and advancements that have impacted the field of data engineering. If you’re like me, you’ve been riding the data wave, watching how tools, technologies, and strategies evolve at breakneck speed.
Robinhood
DECEMBER 18, 2024
Payne joins the Robinhood Board of Directors bringing decades of technology and product experience Were excited to announce Christopher Payne has joined Robinhood Markets Board of Directors. Christopher is a seasoned operator who has helped build category-defining companies at pivotal points in their evolution, said Vlad Tenev, Chairman and Chief Executive Officer of Robinhood.
Data Engineering Weekly
DECEMBER 18, 2024
DEW published The State of Data Engineering in 2024: Key Insights and Trends , highlighting the key advancements in the data space in 2024. We witnessed the explosive growth of Generative AI, the maturing of data governance practices, and a renewed focus on efficiency and real-time processing. But what does 2025 hold? After analyzing emerging patterns and vibrant conversations within the data community, DEW presents our top five predictions for the trends shaping the data world in the coming yea
Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives
Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri
Engineering at Meta
DECEMBER 18, 2024
How did the Threads iOS team maintain the app’s performance during its incredible growth? Here’s how Meta’s Threads team thinks about performance, including the key metrics we monitor to keep the app healthy. We’re also diving into some case studies that impact publish reliability and navigation latency. When Meta launched Threads in 2023, it became the fastest-growing app in history, gaining 100 million users in only five days.
Cloudera
DECEMBER 18, 2024
Its no secret that women have long been underrepresented in the tech space. This issue demands our attention, as it not only limits opportunities for women to work, grow, and thrive but also hinders companies in their pursuit of top talent. Although global organizations, policies and programs to address this issue have gained momentum in recent years, theres work still left to do.
Engineering at Meta
DECEMBER 18, 2024
Meta has been on a years-long undertaking to translate our entire Android codebase from Java to Kotlin. Today, despite having one of the largest Android codebases in the world, we’re well past the halfway point and still going. We’re sharing some of the tradeoffs we’ve made to support automating our transition to Kotlin, seemingly simple transformations that are surprisingly tricky, and how we’re collaborating with other companies to capture hundreds more corner cases.
Precisely
DECEMBER 18, 2024
Black Friday has long represented a high-stakes opportunity for retailers, with Big Box and electronics giants vying for dominance. However, this year told a different story. Google Trends revealed an unexpected rise in interest in hobby stores, particularly outdoor retailers and arts-and-crafts shops. This shift signals more than a seasonal anomalyit reflects a profound change in what customers value.
Advertisement
With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you
Lyft Engineering
DECEMBER 18, 2024
Written by AlexChantavy Today were thrilled to announce that Lyft has donated Cartography to the Cloud Native Computing Foundation ( CNCF ). Since Lyft open sourced it in 2019, its been rewarding to see the project grow from an experimental tool to a solution thats been battle-tested in production by multiple companies. In this post, well reflect on our learnings from Cartographys open source journey and discuss where its goingnext.
Zalando Engineering
DECEMBER 18, 2024
Recommender systems are vital for personalizing user experiences across various platforms. At Zalando, these systems play a crucial role in tailoring content to individual users, thereby enhancing engagement and satisfaction. This is particularly important for Zalando Homepage, which serves as the customers' first impression of the company. Our current recommendation system employed on the Home page excels by leveraging user-content interactions and optimizing for predicted click through rate (C
Expert insights. Personalized for you.
93 
Let's personalize your content