Hevo

AUGUST 27, 2024

Over the past few years, MongoDB has become a popular choice for NoSQL Databases. Catering to real-time processing requirements, MongoDB introduced a powerful feature to track data […] With the rise of modern data tools, real-time data processing is no longer a dream.

MongoDB 52

MongoDB NoSQL Kafka Data 52

Confluent

JUNE 8, 2020

We are excited to announce the preview release of the fully managed MongoDB Atlas source and sink connectors in Confluent Cloud, our fully managed event streaming service based on Apache […].

MongoDB 75

MongoDB Cloud Management Kafka 75

AltexSoft

OCTOBER 21, 2022

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. What is Kafka?

Kafka 93

Kafka Hadoop Big Data ETL Tools 93

Rockset

SEPTEMBER 25, 2020

According to over 40,000 developers, MongoDB is the most popular NOSQL database in use right now. From a developer perspective, MongoDB is a great solution for supporting modern data applications. This blog post will look at three of them: tailing MongoDB with an oplog, using MongoDB change streams, and using a Kafka connector.

MongoDB 52

MongoDB Kafka Database NoSQL 52

Rockset

JUNE 9, 2020

In the course of implementing the Rockset connector to MongoDB , we did a fair amount of research on the MongoDB user experience, both online and through user interviews. Sharding What is MongoDB Sharding and the Best Practices? This was a recurring theme we heard when speaking with MongoDB users.

MongoDB 52

MongoDB NoSQL Database Kafka 52

Confluent

JUNE 11, 2019

Here in part 4 of the Spring for Apache Kafka Deep Dive blog series, we will cover: Common event streaming topology patterns supported in Spring Cloud Data Flow. Create and manage event streaming pipelines, including a Kafka Streams application using Spring Cloud Data Flow.

Kafka 86

Kafka Cloud Java MongoDB 86

Confluent

JUNE 5, 2020

Most organisations maintain fleets, a collection of vehicles put to use for day-to-day operations. Telcos use a variety of vehicles including cars, vans, and trucks for service, delivery, and maintenance. […].

MongoDB 108

MongoDB Cloud Management Kafka 108

Rockset

JUNE 16, 2020

MongoDB.live took place last week, and Rockset had the opportunity to participate alongside members of the MongoDB community and share about our work to make MongoDB data accessible via real-time external indexing. We would be responsible for building and maintaining pipelines from these sources to MongoDB.

MongoDB 52

MongoDB Data Lake PostgreSQL Kafka 52

Rockset

OCTOBER 1, 2020

The data sources available include: users (MongoDB): Core customer data such as name, age, gender, address. online_orders (MongoDB): Online purchase data including product details and delivery addresses. instore_orders (MongoDB): In-store purchase data again including product details and store location. SELECT users.id

MongoDB 40

MongoDB Kafka Building Data Warehouse 40

Data Engineering Podcast

SEPTEMBER 11, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Pipeline 130

Data Pipeline Building MongoDB MySQL 130

Data Engineering Podcast

AUGUST 6, 2017

Contact Information Email @rywalker on Twitter Links Astronomer Kiss Metrics Segment Marketing tools chart Clickstream HIPAA FERPA PCI Mesos Mesos DC/OS Airflow SSIS Marathon Prometheus Grafana Terraform Kafka Spark ELK Stack React GraphQL PostGreSQL MongoDB Ceph Druid Aries Vault Adapter Pattern Docker Kinesis API Gateway Kong AWS Lambda Flink Redshift (..)

MongoDB 100

MongoDB PostgreSQL Data Pipeline Kafka 100

Data Engineering Podcast

MAY 27, 2018

It’s easy to get one started but difficult to manage as new requirements are added and greater scalability becomes necessary.

Data Pipeline 100

Data Pipeline MongoDB Google Cloud Scala 100

Confluent

MAY 12, 2020

Imagine you’ve got a stream of data; it’s not “big data,” but it’s certainly a lot. Within the data, you’ve got some bits you’re interested in, and of those bits, […].

Kafka 141

Kafka Building Big Data MongoDB 141

Confluent

DECEMBER 31, 1969

Connect any database to MongoDB using Confluent's cloud-native data streaming platform. Modernize any database, build streaming data pipelines, and empower real-time data in minutes.

MongoDB 52

MongoDB Database Kafka Data Pipeline 52

Confluent

MAY 6, 2021

Today, Confluent is announcing the general availability (GA) of the fully managed MongoDB Atlas Source and MongoDB Atlas Sink Connectors within Confluent Cloud. Now, with just a few simple clicks, […].

MongoDB 52

MongoDB Cloud Management Kafka 52

Data Engineering Podcast

AUGUST 21, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Lambda Architecture 100

Lambda Architecture MongoDB MySQL Scala 100

Monte Carlo

OCTOBER 31, 2024

Data Engineering Tools Data engineers need to be comfortable using essential tools for data pipeline management and workflow orchestration, including Apache Kafka, Apache Spark, Airflow, Dagster, dbt, and many more. Get familiar with data warehouses, data lakes, and data lakehouses, including MongoDB , Cassandra, BigQuery, Redshift and more.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Confluent

JULY 13, 2021

In Data Science projects, we distinguish between descriptive analytics and statistical models running in production. Overall, these can be seen as one process. You start with analyzing historical data to […].

Data Analysis 138

Data Analysis Kafka Data Science Data 138

Data Engineering Podcast

JANUARY 13, 2019

Contact Info Ajay @acoustik on Twitter LinkedIn Mike LinkedIn Website @michaelfreedman on Twitter Timescale Website Documentation Careers timescaledb on GitHub @timescaledb on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Database 100

Database PostgreSQL SQL MongoDB 100

Data Engineering Podcast

OCTOBER 5, 2021

How did the constraint of supporting the Kafka API influence your implementation strategy for transaction semantics? How did the constraint of supporting the Kafka API influence your implementation strategy for transaction semantics? What are the elements of streaming systems that make atomic transactions a complex problem?

Engineering 100

Engineering MongoDB Kafka Data Lake 100

Data Engineering Podcast

FEBRUARY 11, 2018

Links Timescale PostGreSQL Citus Timescale Design Blog Post MIT NYU Stanford SDN Princeton Machine Data Timeseries Data List of Timeseries Databases NoSQL Online Transaction Processing (OLTP) Object Relational Mapper (ORM) Grafana Tableau Kafka When Boring Is Awesome PostGreSQL RDS Google Cloud SQL Azure DB Docker Continuous Aggregates Streaming Replication (..)

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Data Engineering Podcast

MARCH 8, 2021

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Molecula Pilosa Podcast Episode The Social Dilemma Feature Store Cassandra Elasticsearch Podcast Episode Druid MongoDB SwimOS Podcast Episode Kafka Kafka (..)

IT 100

IT Data Warehouse MongoDB Kafka 100

Rockset

DECEMBER 14, 2022

Rockset’s native connector for Amazon Managed Streaming for Apache Kafka (MSK) makes it simpler and faster to ingest streaming data for real-time analytics. Amazon MSK is a fully managed AWS service that gives users the ability to build and run applications using Apache Kafka.

Kafka 52

Kafka MongoDB SQL AWS 52

Rockset

AUGUST 25, 2020

In Part One , we discussed how to first identify slow queries on MongoDB using the database profiler, and then investigated what the strategies the database took doing during the execution of those queries to understand why our queries were taking the time and resources that they were taking.

MongoDB 40

MongoDB NoSQL SQL Database 40

Data Engineering Podcast

APRIL 19, 2020

The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA Support Data Engineering Podcast Summary Modern applications frequently require access to real-time data, but building and maintaining the systems that make that possible is a complex and time consuming endeavor.

Building 100

Building PostgreSQL MongoDB SQL 100

Rockset

SEPTEMBER 14, 2021

We’re introducing a new Rockset Integration for Apache Kafka that offers native support for Confluent Cloud and Apache Kafka, making it simpler and faster to ingest streaming data for real-time analytics. With the Kafka Integration, users no longer need to build, deploy or operate any infrastructure component on the Kafka side.

Kafka 52

Kafka SQL MongoDB Computer Science 52

Data Engineering Podcast

NOVEMBER 20, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Hevo]([link] Are you sick of repetitive, time-consuming ELT work?

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Confluent

AUGUST 19, 2019

It points to best practices for anyone writing Kafka Connect connectors. In a nutshell, the document states that sources and sinks are verified as Gold if they’re functionally equivalent to Kafka Connect connectors. Over the years, we’ve since seen wide adoption of Kafka Connect.

Programming 15

Programming Kafka Database-centric MongoDB 15

Data Engineering Podcast

DECEMBER 4, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

JULY 10, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Metadata 100

Metadata MongoDB MySQL Machine Learning 100

Data Engineering Podcast

SEPTEMBER 25, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Food 100

Food MongoDB MySQL Scala 100

Knowledge Hut

APRIL 25, 2024

There are a variety of big data processing technologies available, including Apache Hadoop, Apache Spark, and MongoDB. The most popular NoSQL database systems include MongoDB, Cassandra, and HBase. In general, Hadoop and Spark are good choices for batch processing, while Kafka and Storm are better suited for streaming applications.

Big Data 98

Big Data Technology Hadoop NoSQL 98

Data Engineering Podcast

AUGUST 6, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Machine Learning 100

Machine Learning Database MySQL MongoDB 100

Confluent

OCTOBER 13, 2021

Machine learning on real-time data is a powerful combination because you gain direct insights into your data, can make powerful decisions, and consequently improve your business processes and outcomes. It […].

Kafka 90

Kafka Machine Learning Process MongoDB 90

Striim

AUGUST 26, 2023

Users often have to grapple with intricate, low-level Kafka elements like topics, brokers, partitions, taking focus away from more strategic tasks. AWS MSK : An Apache Kafka-compatible managed streaming platform that also allows users to access other AWS services directly. Frequently Asked Questions What is Apache Kafka?

MongoDB 52

MongoDB Google Cloud Kafka AWS 52

ProjectPro

FEBRUARY 1, 2017

The data architecture is based on open source standards Pentaho and is used for managing, preparing and integrating data that runs through their environments including Cloudera Hadoop Distribution , HP Vertica, Flume and Kafka. Source : [link] How Hadoop helps Experian crunch credit reports. Source : [link] ) Bringing Hadoop to the mainframe.

Hadoop 52

Hadoop MongoDB Big Data Kafka 52

Knowledge Hut

DECEMBER 21, 2023

Understanding of Big Data technologies such as Hadoop, Spark, and Kafka. Familiarity with database technologies such as MySQL, Oracle, and MongoDB. Knowledge of Hadoop, Spark, and Kafka. Familiarity with database technologies such as MySQL, Oracle, and MongoDB. How Much Do Data Engineers Make?

Data Engineering 52

Data Engineering Data Engineer Engineering MongoDB 52