Data Engineering Podcast

OCTOBER 23, 2022

In this episode field CTO Manjot Singh shares his experiences as an early user of MySQL and MariaDB and explains how the suite of products being built on top of the open source foundation address the growing needs for advanced storage and analytical capabilities. Mention the podcast to get a free "In Data We Trust World Tour" t-shirt.

Database 100

Database MySQL Cloud MongoDB 100

Christophe Blefari

JUNE 21, 2024

Native CDC for Postgres and MySQL — Snowflake will be able to connect to Postgres and MySQL to natively move data from your databases to the warehouse. While I enjoy these events, I prefer avoid flying for ecological reasons, and large gatherings can be challenging for an introvert like me. But what is doing Tabular?

Metadata 147

Metadata Data Warehouse BI Scala 147

Data Engineering Podcast

DECEMBER 11, 2022

Planetscale is a serverless option for your MySQL workloads that lets you focus on your applications without having to worry about managing the database or fight with differences between development and production. RudderStack helps you build a customer data platform on your warehouse or data lake.

Database 100

Database MySQL Data Lake MongoDB 100

Confluent

JUNE 18, 2019

Software projects of all sizes and complexities have a common challenge: building a scalable solution for search. Building a resilient and scalable solution is not always easy. It involves many moving parts, from data preparation to building indexing and query pipelines. Building an indexing pipeline at scale with Kafka Connect.

Architecture 97

Architecture Building Kafka Database-centric 97

Data Engineering Podcast

DECEMBER 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Workfall

JANUARY 17, 2024

FastAPI is a modern, high-performance web framework for building APIs with Python based on standard type hints. The framework is designed to optimize your developer experience so that you can write simple code to build production-ready APIs with best practices by default. Let’s connect the MySQL database to our python application.

Python 76

Python MySQL Coding Database 76

Data Engineering Podcast

JUNE 22, 2021

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Database 100

Database MySQL PostgreSQL Data Warehouse 100

Data Engineering Podcast

DECEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode. Upsolver]([link] Build Real-Time Pipelines.

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Rockset

MAY 11, 2021

For example, what happens when you have an event stream like Kafka but also dimension tables in your transactional database like MySQL or Postgres ? Time to market is the most important currency for fast-moving companies building data applications. Instead look for real-time analytics platforms that are fully mutable.

Building 52

Building MySQL Kafka Data Preparation 52

Edureka

AUGUST 26, 2024

These are basically a collection of technologies used together to build web applications. Angular is an advanced front-end framework created by Google for building dynamic single-page applications. The great thing about any of these stacks is that they teach important skills necessary for building strong web applications.

MongoDB 97

MongoDB Programming Language MySQL Certification 97

LinkedIn Engineering

APRIL 18, 2023

Minion (an agent on host) sees jobs and results by subscribing to events published on the event bus by master service, It uses ZMQ (ZeroMQ) to achieve high-speed, asynchronous communication between connected systems. Targeted minions execute the job on the host and return to master.

MySQL 103

MySQL Python Bytes Kafka 103

Data Engineering Podcast

NOVEMBER 20, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 130

Data Lake Data Ingestion MongoDB Google Cloud 130

Netflix Tech

DECEMBER 17, 2019

CDC is becoming increasingly popular for use cases that require keeping multiple heterogeneous datastores in sync (like MySQL and ElasticSearch) and addresses challenges that exist with traditional techniques like dual-writes and distributed transactions [3][4]. Some of DBLog’s features are: Processes captured log events in-order.

MySQL 87

MySQL PostgreSQL Database Transportation 87

Data Engineering Podcast

NOVEMBER 27, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. RudderStack also supports real-time use cases.

Data Lake 100

Data Lake Data Warehouse MongoDB Data Pipeline 100

Netflix Tech

DECEMBER 17, 2019

CDC is becoming increasingly popular for use cases that require keeping multiple heterogeneous datastores in sync (like MySQL and ElasticSearch) and addresses challenges that exist with traditional techniques like dual-writes and distributed transactions [3][4]. Some of DBLog’s features are: Processes captured log events in-order.

MySQL 81

MySQL PostgreSQL Database Transportation 81

Data Engineering Podcast

NOVEMBER 6, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

MongoDB 130

MongoDB Scala MySQL Machine Learning 130

Data Engineering Podcast

AUGUST 6, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. an image vs. an audio file, etc.)

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

JUNE 12, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Unstructured Data 130

Unstructured Data MongoDB Scala MySQL 130

Data Engineering Podcast

SEPTEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

JUNE 5, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

MongoDB 100

MongoDB MySQL Data Lake Data Warehouse 100

Data Engineering Podcast

JULY 24, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. You’re releasing the stable 1.0

MongoDB 100

MongoDB Scala MySQL Data Lake 100

Data Engineering Podcast

AUGUST 21, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 100

Metadata MongoDB MySQL Data Lake 100

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 130

Metadata MongoDB Scala MySQL 130

Data Engineering Podcast

DECEMBER 4, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

NOVEMBER 13, 2022

Summary CreditKarma builds data products that help consumers take advantage of their credit and financial capabilities. In this episode Vishnu Venkataraman shares the journey that he and his team have taken to build and evolve their systems and improve the product offerings that they are able to support.

MongoDB 100

MongoDB Google Cloud Scala MySQL 100

Data Engineering Podcast

OCTOBER 30, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Can you describe what Optimus is?

Engineering 100

Engineering MongoDB Scala MySQL 100

Pinterest Engineering

NOVEMBER 18, 2024

Introducing Generic CDC To address these challenges, we have decided to build a Generic CDC solution based on Red Hat Debezium (™). While the open source Debezium connector, such as the MySQL connector, works seamlessly for a single shard, the challenge lies in making it compatible with our distributed databases. or its affiliates.

Kafka 46

Kafka MySQL Database Software Engineer 46

Data Engineering Podcast

DECEMBER 18, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode. Upsolver]([link] Build Real-Time Pipelines.

Data Lake 100

Data Lake Data Warehouse Data Pipeline MongoDB 100

Knowledge Hut

DECEMBER 21, 2023

We must learn how to build an instance of the Azure Database for the PostgreSQL client tool. Even though OmniDB supports other database architectures like MySQL, Oracle, and MariaDB, PostgreSQL is its main focus. Navicat Navicat is a GUI for MySQL, PostgreSQL, Oracle, and MongoDB. The UI of TablePlus is a simple UI.

PostgreSQL 52

PostgreSQL MySQL MongoDB SQL 52

Data Engineering Podcast

JULY 17, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Cloudera

AUGUST 10, 2022

CSP allows developers, data analysts, and data scientists to build hybrid streaming data pipelines where time is a crucial factor, such as fraud detection, network threat analysis, instantaneous loan approvals, and so on. It is an industry standard for the implementation of event-driven applications. Apache Kafka and SMM.

Process 89

Process Kafka PostgreSQL MySQL 89

Data Engineering Podcast

AUGUST 28, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Data Engineering Podcast

OCTOBER 16, 2022

In this episode Jason Hughes explains what it means for a lakehouse to be "open" and describes the different components that the Dremio team build and contribute to. RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Lake 100

Data Lake Food MongoDB Scala 100

Data Engineering Podcast

MARCH 2, 2020

Summary Building applications on top of unbounded event streams is a complex endeavor, requiring careful integration of multiple disparate systems that were engineered in isolation. The ksqlDB project was created to address this state of affairs by building a unified layer on top of the Kafka ecosystem for stream processing.

Kafka 100

Kafka Process PostgreSQL MySQL 100

Data Engineering Podcast

JULY 10, 2022

Summary Building and maintaining reliable data assets is the prime directive for data engineers. In this episode Chris Riccomini shares his experiences building and scaling data operations at WePay and LinkedIn, as well as the lessons he has learned working with other teams as they automated their own systems.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Knowledge Hut

MAY 31, 2023

Top Database Project Ideas Using MySQL MySQL is a popular open-source database management system. Some of the most important lists of database project examples using MySQL are: Online Job Portal using Python and SQL database An online job portal is a platform that connects job seekers with potential employers.

Database 52

Database Coding MongoDB Project 52

Data Engineering Podcast

JULY 10, 2022

Summary Building a data platform is a journey, not a destination. Beyond the work of assembling a set of technologies and building integrations across them, there is also the work of growing and organizing a team that can support and benefit from that platform. Need to automate data pipelines with less red tape? What does Riskified do?

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100