Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. The future of data teams depends on their ability to adapt to new challenges and seize emerging opportunities.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. The future of data teams depends on their ability to adapt to new challenges and seize emerging opportunities.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Data Engineering Weekly

NOVEMBER 24, 2024

Editor’s Note: Launching Data & Gen-AI courses in 2025 I can’t believe DEW will reach almost its 200th edition soon. What I started as a fun hobby has become one of the top-rated newsletters in the data engineering industry. We are planning many exciting product lines to trial and launch in 2025.

Data Engineering 57

Data Engineering Data Engineer Engineering Insurance 57

Data Engineering Weekly

MARCH 30, 2025

Save Your Spot → Editor’s Note: Data Council 2025, Apr 22-24, Oakland, CA Data Council has always been one of my favorite events to connect with and learn from the data engineering community. Data Council 2025 is set for April 22-24 in Oakland, CA. link] BVP: Roadmap: Data 3.0

Data Engineering 57

Data Engineering Data Engineer Engineering Pipeline-centric 57

Data Engineering Weekly

DECEMBER 16, 2024

Evolution of Data Lake Technologies The data lake ecosystem has matured significantly in 2024, particularly in table formats and storage technologies. Data Mesh, Data Products, and Data Contracts Miro exemplifies the shift toward metadata-driven workflows by transitioning from Airflow code to DataHub YAML specifications.

Data Engineering 62

Data Engineering Data Engineer Engineering Unstructured Data 62

Knowledge Hut

DECEMBER 26, 2023

Data Engineering is typically a software engineering role that focuses deeply on data – namely, data workflows, data pipelines, and the ETL (Extract, Transform, Load) process. If we look at history, the data that was generated earlier was primarily structured and small in its outlook.

Data Engineering 98

Data Engineering Data Engineer Engineering Hadoop 98

Ascend.io

MARCH 19, 2025

Data engineering in 2025 isn’t just about moving datait’s about ensuring reliability, security, and scalability as data ecosystems grow in complexity. As pipelines grow more complex and AI-integrated workflows become the standard, the difference between success and chaos lies in the practices data teams adopt.

Data Engineering 52

Data Engineering Data Engineer Engineering Metadata 52