Data Engineering Weekly
OCTOBER 27, 2024
Astasia Myers: The three components of the unstructured data stack LLMs and vector databases significantly improved the ability to process and understand unstructured data. I never thought of PDF as a self-contained document database, but that seems a reality that we can’t deny. The blog is an excellent summary of the existing unstructured data landscape.
databricks
OCTOBER 27, 2024
We're excited to announce the General Availability of Publish to Microsoft Power BI Service from Unity Catalog, an integration that makes it easy.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Uber Engineering
OCTOBER 27, 2024
Learn how Uber is streamlining the Cloud migration of its massive Data Lake by incorporating key Data Mesh principles.
Uber Engineering
OCTOBER 27, 2024
Discover how Uber’s in-house ETL framework helps standardize modular ETL development, improving developer productivity and ensuring reliable data pipelines.
Advertisement
In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate
Uber Engineering
OCTOBER 27, 2024
Explore how Uber is leveraging Genie, its Generative AI-powered On-Call CoPilot, to transform on-call operations and empower engineering teams.
Uber Engineering
OCTOBER 27, 2024
Discover how to enable intelligent and efficient data analytics at Uber scale with Preon, a Presto Query Analysis service that unlocks insights for deduplicating queries, creating efficient table layouts, and more.
Expert insights. Personalized for you.
57 
Let's personalize your content