Remove Engineering Remove MongoDB Remove SQL
article thumbnail

Getting started with the MongoDB Connector for Apache Kafka and MongoDB

Confluent

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers.

MongoDB 21
article thumbnail

Designing A Non-Relational Database Engine

Data Engineering Podcast

The default association with the term "database" is relational engines, but non-relational engines are also used quite widely. In this episode Oren Eini, CEO and creator of RavenDB, explores the nuances of relational vs. non-relational engines, and the strategies for designing a non-relational database.

article thumbnail

OLTP Vs OLAP – What Is The Difference

Seattle Data Guy

Adding databases like MongoDB and CassandraDB only makes matters worse, since they’re not SQL-friendly – the language most analysts and data practitioners are used to.… If you’re relying on your OLTP system to provide analytics, you might be in for a surprise.

MongoDB 208
article thumbnail

Planet Scale SQL For The New Generation Of Applications With YugabyteDB

Data Engineering Podcast

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. A growing trend in database engines (e.g.

SQL 100
article thumbnail

Adding Support For Distributed Transactions To The Redpanda Streaming Engine

Data Engineering Podcast

In this episode Denis Rystsov explains how he added support for transactions to the Redpanda streaming engine. This is an interesting deep dive into the internals of a high performance streaming engine and the details that are involved in building distributed systems. Struggling with broken pipelines? Stale dashboards? Missing data?

article thumbnail

Data News — Week 24.08

Christophe Blefari

This week I've participated to a round table about data and did a cool presentation about Engines. The idea was to depict the history of engines over the last 40 years and what leads to polars and DuckDB. Engines evolution (me) There are 3 points that have triggered discussion about the visualisation I done What about Arrow?

Data Lake 130
article thumbnail

Maintain Your Data Engineers' Sanity By Embracing Automation

Data Engineering Podcast

Summary Building and maintaining reliable data assets is the prime directive for data engineers. In order to make this a tractable problem it is essential that engineers embrace automation at every opportunity. If you’re a data engineering podcast listener, you get credits worth $5,000 when you become a customer.