article thumbnail

Kafka to MongoDB: Building a Streamlined Data Pipeline

Analytics Vidhya

We know that streaming data is data that is emitted at high volume […] The post Kafka to MongoDB: Building a Streamlined Data Pipeline appeared first on Analytics Vidhya. Handling and processing the streaming data is the hardest work for Data Analysis.

MongoDB 217
article thumbnail

Getting Started with MongoDB: Installation and Setup Guide

KDnuggets

MongoDB is a database that’s great for handling large amounts of diverse data. This article walks you through installing MongoDB and using the MongoDB Shell to manage your data easily.

MongoDB 140
article thumbnail

Getting started with the MongoDB Connector for Apache Kafka and MongoDB

Confluent

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers. Free MongoDB Atlas cluster.

MongoDB 21
article thumbnail

Designing A Non-Relational Database Engine

Data Engineering Podcast

Summary Databases come in a variety of formats for different use cases. The default association with the term "database" is relational engines, but non-relational engines are also used quite widely. Can you describe what constitutes a NoSQL database? If you were to start from scratch today, what database would you build?

article thumbnail

OLTP Vs OLAP – What Is The Difference

Seattle Data Guy

Adding databases like MongoDB and CassandraDB only makes matters worse, since they’re not SQL-friendly – the language most analysts and data practitioners are used to.… If you’re relying on your OLTP system to provide analytics, you might be in for a surprise.

MongoDB 208
article thumbnail

Database Refactoring Patterns with Pramod Sadalage - Episode 22

Data Engineering Podcast

Summary As software lifecycles move faster, the database needs to be able to keep up. You first co-authored Refactoring Databases in 2006. What was the state of software and database system development at the time and why did you find it necessary to write a book on this subject?

Database 100
article thumbnail

Running Your Database On Kubernetes With KubeDB

Data Engineering Podcast

However, managing the database layer is still a separate concern. In this episode Tamal Saha explains how the KubeDB project got started, why you might want to run your database with Kubernetes, and how to get started. Can you talk through how KubeDB simplifies the process of deploying and maintaining databases?

Database 100