Sun.Oct 27, 2024

article thumbnail

Announcing General Availability: Publish to Microsoft Power BI Service from Unity Catalog

databricks

We're excited to announce the General Availability of Publish to Microsoft Power BI Service from Unity Catalog, an integration that makes it easy.

BI 119
article thumbnail

DataMesh: How Uber laid the foundations for the data lake cloud migration

Uber Engineering

Learn how Uber is streamlining the Cloud migration of its massive Data Lake by incorporating key Data Mesh principles.

article thumbnail

Data Engineering Weekly #195

Data Engineering Weekly

Astasia Myers: The three components of the unstructured data stack LLMs and vector databases significantly improved the ability to process and understand unstructured data. I never thought of PDF as a self-contained document database, but that seems a reality that we can’t deny. The blog is an excellent summary of the existing unstructured data landscape.

article thumbnail

Sparkle: Standardizing Modular ETL at Uber

Uber Engineering

Discover how Uber’s in-house ETL framework helps standardize modular ETL development, improving developer productivity and ensuring reliable data pipelines.

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Genie: Uber’s Gen AI On-Call Copilot

Uber Engineering

Explore how Uber is leveraging Genie, its Generative AI-powered On-Call CoPilot, to transform on-call operations and empower engineering teams.

article thumbnail

Preon: Presto Query Analysis for Intelligent and Efficient Analytics

Uber Engineering

Discover how to enable intelligent and efficient data analytics at Uber scale with Preon, a Presto Query Analysis service that unlocks insights for deduplicating queries, creating efficient table layouts, and more.