Building Data Workflow Pipeline-centric 
Snowflake
APRIL 17, 2024
In today’s data-driven world, developer productivity is essential for organizations to build effective and reliable products, accelerate time to value, and fuel ongoing innovation. Dive in to experience how the enhanced Python API streamlines your data workflows and unlocks the full potential of Python within Snowflake.
Data Engineering Podcast
JUNE 30, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. What does an on-call rotation for a data engineer/data platform engineer look like as compared with an application-focused team?
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Data Engineering Weekly
NOVEMBER 3, 2024
impactdatasummit.com Thumbtack: What we learned building an ML infrastructure team at Thumbtack Thumbtack shares valuable insights from building its ML infrastructure team. The blog emphasizes the importance of starting with a clear client focus to avoid over-engineering and ensure user-centric development.
Edureka
APRIL 22, 2025
Since all of Fabric’s tools run natively on OneLake, real-time performance without data duplication is possible in Direct Lake mode. Because of the architecture’s ability to abstract infrastructure complexity, users can focus solely on data workflows. Cloud support Microsoft Fabric: Works only on Microsoft Azure.
Data Engineering Weekly
MARCH 30, 2025
A few exciting theses exist around composite data stack, catalogs, and MCP. Eval plays a critical role in the growth and maturity of LLM-centric systems. The paper critically examines the Text2SQL task, highlighting that limitations go beyond model performance to encompass the entire solution pipeline and evaluation process.
François Nguyen
MARCH 22, 2021
TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. How do we build data products ? The next problem will be the diversity of these mini data platforms (because of the configuration) and you even go deeper in problems with managing different technologies or version.
Knowledge Hut
DECEMBER 26, 2023
Data Engineering is typically a software engineering role that focuses deeply on data – namely, data workflows, data pipelines, and the ETL (Extract, Transform, Load) process. What is the role of a Data Engineer? They are required to have deep knowledge of distributed systems and computer science.
Expert insights. Personalized for you.
124 
Let's personalize your content