Data Schemas, High Quality Data and Kafka

Build vs Buy Data Pipeline Guide

Monte Carlo

APRIL 24, 2023

If streaming data is a priority for your platform, you might also choose to leverage a system like Confluent’s Apache Kafka along with some of the above mentioned technologies. Due to the different disparate moving technologies involved in ingestion, you may need some combination of Fivetran, Kafka , Spark , data lake formats and more.

Data Pipeline

Data Pipeline Building Data Ingestion BI

Implementing Data Contracts in the Data Warehouse

Monte Carlo

JANUARY 25, 2023

There is, however, an added dimension to this relationship: data producers are often consumers of upstream data sources. Data warehouse producers wear both hats working with upstream producers so they can consume high-quality data and producing high-quality data to provide to their consumers.

Data Warehouse

Data Warehouse Data High Quality Data Metadata

Data Engineering Digest

Build vs Buy Data Pipeline Guide

Implementing Data Contracts in the Data Warehouse

Webinars

Stay Connected