Data Engineering Podcast

JANUARY 21, 2024

Summary Databases and analytics architectures have gone through several generational shifts. A substantial amount of the data that is being managed in these systems is related to customers and their interactions with an organization. How has that changed the architectural approach to CDPs? Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

ProjectPro

JUNE 6, 2025

This beginner's guide will give you a detailed overview of Azure Synapse Analytics and its architecture to help you build enterprise-grade data pipelines for your next data analytics project. Table of Contents What is Azure Synapse Analytics? Why Use Azure Synapse Analytics For Big Data Analytics Projects?

Data Engineering 40

Data Engineering Data Engineer Engineering Data Lake 40

Towards Data Science

JANUARY 16, 2024

My personal take on justifying the existence of Data Mesh A senior stakeholder at one my projects mentioned that they wanted to decentralise their data platform architecture and democratise data across the organisation. When I heard the words ‘decentralised data architecture’, I was left utterly confused at first!

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

DataKitchen

AUGUST 19, 2021

Below is our fourth post (4 of 5) on combining data mesh with DataOps to foster innovation while addressing the challenges of a decentralized architecture. We’ve covered the basic ideas behind data mesh and some of the difficulties that must be managed. Figure 1: Data requirements for phases of the drug product lifecycle.

Pharmaceutical 98

Pharmaceutical Data Lake Data Warehouse Raw Data 98

Data Engineering Podcast

AUGUST 21, 2022

Select Star’s data discovery platform solves that out of the box, with an automated catalog that includes lineage from where the data originated, all the way to which dashboards rely on it and who is viewing them every day. Can you describe what is driving the adoption of real-time analytics?

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Striim

AUGUST 22, 2024

What’s the difference between real-time analytics and streaming analytics? Streaming analytics focuses on analyzing data in motion, unlike traditional analytics, which deals with data stored in databases or data warehouses.

Data Warehouse 52

Data Warehouse Retail Machine Learning Data Lake 52

Data Engineering Weekly

NOVEMBER 13, 2022

The author narrates how OS-C adopted Data Contract and federated data governance strategy to help fight against climate change. link] Sponsored: Why You Should Care About Dimensional Data Modeling It's easy to overlook all of the magic that happens inside the data warehouse.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52