Data Engineering Podcast

JUNE 16, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Can you describe what role Trino and Iceberg play in Stripe's data architecture? Can you describe what role Trino and Iceberg play in Stripe's data architecture?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

DataKitchen

JANUARY 3, 2022

They need high-quality data in an answer-ready format to address many scenarios with minimal keyboarding. What they are getting from IT and other data sources is, in reality, poor-quality data in a format that requires manual customization. A lot of industries talk about bringing data together in data hubs.

Business Analyst 98

Business Analyst Data Lake Consulting Data Analytics 98

Monte Carlo

JULY 27, 2023

These specialists are also commonly referred to as data reliability engineers. To be successful in their role, data quality engineers will need to gather data quality requirements (mentioned in 65% of job postings) from relevant stakeholders.

Engineering 52

Engineering Healthcare Data Warehouse Scala 52

Monte Carlo

AUGUST 13, 2024

This year data observability skyrocketed to the top of the Gartner’s Hype Cycles. According to Gartner, 50% of enterprise companies implementing distributed data architectures will have adopted data observability tools by 2026 – up from just ~20% in 2024. Image courtesy of Gartner.

Data 52

Data Data Warehouse Data Pipeline Data Architecture 52

RandomTrees

MAY 6, 2025

Modern data engineering can help with this. It creates the systems and processes needed to gather, clean, transfer, and prepare data for AI models. Without it, AI technologies wouldn’t have access to high-quality data. It incorporates far more than basic data handling techniques.

Data Engineer 52

Data Engineer Data Engineering Engineering Data Cleanse 52