Confluent

DECEMBER 28, 2020

Before you say it: Yes, we are right now three days past Christmas, but technically the 12 days of Christmas refer to the days between Christmas and Epiphany, which is—I […].

Kafka 145

Kafka IT 145

Start Data Engineering

JANUARY 1, 2021

Introduction Why Change Data Capture Setup Prerequisites Source setup Destination setup Source, MySQL CDC, MySQL => PostgreSQL Pros and Cons Pros Cons Conclusion References Introduction Change data capture is a software design pattern used to track every change(update, insert, delete) to the data in a database. In most databases these types of changes are added to an append only log (Binlog in MySQL, Write Ahead Log in PostgreSQL).

PostgreSQL 130

PostgreSQL MySQL Database Data 130

Data Engineering Podcast

DECEMBER 28, 2020

Summary One of the core responsibilities of data engineers is to manage the security of the information that they process. The team at Satori has a background in cybersecurity and they are using the lessons that they learned in that field to address the challenge of access control and auditing for data governance. In this episode co-founder and CTO Yoav Cohen explains how the Satori platform provides a proxy layer for your data, the challenges of managing security across disparate storage system

Data Governance 130

Data Governance Government Transportation Data 130

DataKitchen

DECEMBER 30, 2020

While 2020 has been a collectively difficult year, we want to take a moment to thank all of our employees for the hard work they put into continually developing our DataKitchen DataOps Platform for our customers. We also want to thank all of the data industry groups that have recognized our DataKitchen DataOps Platform and Transformation Advisory Services throughout the year.

Manufacturing 96

Manufacturing Big Data Data Pipeline Data Science 96

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Teradata

DECEMBER 29, 2020

When considering your organization's move to the cloud, it's imperative to understand what the cloud can and cannot do, and how to best leverage its benefits.

Cloud 90

Cloud IT 90

DareData

JANUARY 1, 2021

DareData is a Data and Artificial Intelligence consulting company working mostly for data-driven clients, whether enterprises or startups. Our mission is to democratize data and AI tools as we feel there is current imbalance in accessibility. We work to provide autonomous paths for every client to access and control data engineering and data science tools by building infrastructure and AI analytics and models.

Consulting 52

Consulting Portfolio Retail Banking 52