Rockset

JUNE 16, 2020

MongoDB.live took place last week, and Rockset had the opportunity to participate alongside members of the MongoDB community and share about our work to make MongoDB data accessible via real-time external indexing. We would be responsible for building and maintaining pipelines from these sources to MongoDB.

MongoDB 52

MongoDB Data Lake PostgreSQL Kafka 52

AltexSoft

OCTOBER 21, 2022

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. What is Kafka?

Kafka 93

Kafka Hadoop Big Data ETL Tools 93

Confluent

DECEMBER 31, 1969

Connect any database to MongoDB using Confluent's cloud-native data streaming platform. Modernize any database, build streaming data pipelines, and empower real-time data in minutes.

MongoDB 52

MongoDB Database Kafka Data Pipeline 52

Confluent

JUNE 8, 2020

We are excited to announce the preview release of the fully managed MongoDB Atlas source and sink connectors in Confluent Cloud, our fully managed event streaming service based on Apache […].

MongoDB 77

MongoDB Cloud Management Kafka 77

Confluent

MAY 6, 2021

Today, Confluent is announcing the general availability (GA) of the fully managed MongoDB Atlas Source and MongoDB Atlas Sink Connectors within Confluent Cloud. Now, with just a few simple clicks, […].

MongoDB 52

MongoDB Cloud Management Kafka 52

Rockset

DECEMBER 14, 2022

Rockset’s native connector for Amazon Managed Streaming for Apache Kafka (MSK) makes it simpler and faster to ingest streaming data for real-time analytics. Amazon MSK is a fully managed AWS service that gives users the ability to build and run applications using Apache Kafka.

Kafka 52

Kafka MongoDB SQL AWS 52

Confluent

JULY 17, 2019

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers.

MongoDB 21

MongoDB Kafka Medical Database 21

Rockset

AUGUST 25, 2020

In Part One , we discussed how to first identify slow queries on MongoDB using the database profiler, and then investigated what the strategies the database took doing during the execution of those queries to understand why our queries were taking the time and resources that they were taking.

MongoDB 40

MongoDB NoSQL SQL Database 40

Confluent

JULY 29, 2020

Change Data Capture (CDC) is an excellent way to introduce streaming analytics into your existing database, and using Debezium enables you to send your change data through Apache Kafka®. Although […].

Kafka 105

Kafka Database MongoDB Data 105

Rockset

SEPTEMBER 14, 2021

We’re introducing a new Rockset Integration for Apache Kafka that offers native support for Confluent Cloud and Apache Kafka, making it simpler and faster to ingest streaming data for real-time analytics. With the Kafka Integration, users no longer need to build, deploy or operate any infrastructure component on the Kafka side.

Kafka 52

Kafka SQL MongoDB Computer Science 52

Confluent

APRIL 9, 2019

I’m excited to announce that we’re partnering with Google Cloud to make Confluent Cloud, our fully managed offering of Apache Kafka ® , available as a native offering on Google Cloud Platform (GCP). Confluent’s founders didn’t just write the original code of Apache Kafka, we also ran it as a service at massive scale.

Google Cloud 101

Google Cloud Kafka Cloud MongoDB 101

Data Engineering Podcast

AUGUST 21, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Lambda Architecture 100

Lambda Architecture MongoDB Scala MySQL 100

Confluent

JUNE 11, 2019

Here in part 4 of the Spring for Apache Kafka Deep Dive blog series, we will cover: Common event streaming topology patterns supported in Spring Cloud Data Flow. Create and manage event streaming pipelines, including a Kafka Streams application using Spring Cloud Data Flow.

Kafka 86

Kafka Cloud Java MongoDB 86

Striim

AUGUST 26, 2023

Users often have to grapple with intricate, low-level Kafka elements like topics, brokers, partitions, taking focus away from more strategic tasks. AWS MSK : An Apache Kafka-compatible managed streaming platform that also allows users to access other AWS services directly. Frequently Asked Questions What is Apache Kafka?

MongoDB 52

MongoDB Google Cloud Kafka AWS 52

Data Engineering Podcast

SEPTEMBER 11, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Data Pipeline 130

Data Pipeline Building MongoDB Scala 130

Confluent

JUNE 5, 2020

Most organisations maintain fleets, a collection of vehicles put to use for day-to-day operations. Telcos use a variety of vehicles including cars, vans, and trucks for service, delivery, and maintenance. […].

MongoDB 108

MongoDB Cloud Management Kafka 108

Rockset

JUNE 2, 2020

MongoDB World is going all virtual with MongoDB.live. If you’re short on time, fear not- here are our top 10 MongoDB sessions to watch out for: 10 Join the Data Movement: MongoDB and Apache Kafka One of the go-to picks for companies that need a streaming platform is Apache Kafka. Are REST APIs are your jam?

MongoDB 52

MongoDB Data Lake Kafka NoSQL 52

Data Engineering Podcast

OCTOBER 5, 2021

How did the constraint of supporting the Kafka API influence your implementation strategy for transaction semantics? How did the constraint of supporting the Kafka API influence your implementation strategy for transaction semantics? What are the elements of streaming systems that make atomic transactions a complex problem?

Engineering 100

Engineering MongoDB Kafka Data Lake 100

Knowledge Hut

APRIL 25, 2024

There are a variety of big data processing technologies available, including Apache Hadoop, Apache Spark, and MongoDB. The most popular NoSQL database systems include MongoDB, Cassandra, and HBase. In general, Hadoop and Spark are good choices for batch processing, while Kafka and Storm are better suited for streaming applications.

Big Data 98

Big Data Technology Hadoop NoSQL 98

Edureka

AUGUST 23, 2024

It also supports third-party services like MongoDB, Datadob, and New Relic. What is the difference between Amazon Kinesis and Kafka? Amazon Kinesis and Apache Kafka are both platforms for real-time data streaming, but they have some key differences. Both Kinesis and Kafka are scalable. Both Kinesis and Kafka are scalable.

AWS 52

AWS Kafka Amazon Web Services Medical 52

Data Engineering Podcast

DECEMBER 4, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

MARCH 8, 2021

To help other people find the show please leave a review on iTunes and tell your friends and co-workers Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat Links Molecula Pilosa Podcast Episode The Social Dilemma Feature Store Cassandra Elasticsearch Podcast Episode Druid MongoDB SwimOS Podcast Episode Kafka Kafka (..)

IT 100

IT Data Warehouse MongoDB Kafka 100

Data Engineering Podcast

SEPTEMBER 25, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Food 100

Food MongoDB Scala MySQL 100

Data Engineering Podcast

AUGUST 28, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Building 100

Building MongoDB Scala MySQL 100

Data Engineering Podcast

NOVEMBER 20, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Hevo]([link] Are you sick of repetitive, time-consuming ELT work?

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Data Engineering Podcast

JULY 10, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Email hosts@dataengineeringpodcast.com ) with your story. Email hosts@dataengineeringpodcast.com ) with your story.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Data Engineering Podcast

AUGUST 6, 2017

Contact Information Email @rywalker on Twitter Links Astronomer Kiss Metrics Segment Marketing tools chart Clickstream HIPAA FERPA PCI Mesos Mesos DC/OS Airflow SSIS Marathon Prometheus Grafana Terraform Kafka Spark ELK Stack React GraphQL PostGreSQL MongoDB Ceph Druid Aries Vault Adapter Pattern Docker Kinesis API Gateway Kong AWS Lambda Flink Redshift (..)

PostgreSQL 100

PostgreSQL MongoDB Data Pipeline Kafka 100

Data Engineering Podcast

JANUARY 13, 2019

Contact Info Ajay @acoustik on Twitter LinkedIn Mike LinkedIn Website @michaelfreedman on Twitter Timescale Website Documentation Careers timescaledb on GitHub @timescaledb on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Database 100

Database PostgreSQL SQL MongoDB 100

Data Engineering Podcast

APRIL 19, 2020

The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA Support Data Engineering Podcast Summary Modern applications frequently require access to real-time data, but building and maintaining the systems that make that possible is a complex and time consuming endeavor.

Building 100

Building PostgreSQL MongoDB SQL 100

Data Engineering Podcast

AUGUST 6, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

MAY 27, 2018

It’s easy to get one started but difficult to manage as new requirements are added and greater scalability becomes necessary.

Data Pipeline 100

Data Pipeline MongoDB Google Cloud Scala 100

Rockset

AUGUST 30, 2021

Apache Kafka has made acquiring real-time data more mainstream, but only a small sliver are turning batch analytics, run nightly, into real-time analytical dashboards with alerts and automatic anomaly detection. But until this release, all these data sources involved indexing the incoming raw data on a record by record basis.

SQL 52

SQL Kafka MongoDB MySQL 52

Cloud Academy

JANUARY 27, 2022

Microsoft SQL Server Document-oriented database: MongoDB (classified as NoSQL) The Basics of Data Management, Data Manipulation and Data Modeling This learning path focuses on common data formats and interfaces. MongoDB Configuration and Setup Watch an example of deploying MongoDB to understand its benefits as a database system.

Certification 52

Certification Data Engineering Data Engineer Engineering 52

Confluent

JULY 13, 2021

In Data Science projects, we distinguish between descriptive analytics and statistical models running in production. Overall, these can be seen as one process. You start with analyzing historical data to […].

Data Analysis 138

Data Analysis Kafka Data Science Data 138

Monte Carlo

OCTOBER 31, 2024

Data Engineering Tools Data engineers need to be comfortable using essential tools for data pipeline management and workflow orchestration, including Apache Kafka, Apache Spark, Airflow, Dagster, dbt, and many more. Get familiar with data warehouses, data lakes, and data lakehouses, including MongoDB , Cassandra, BigQuery, Redshift and more.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Data Engineering Podcast

FEBRUARY 11, 2018

Links Timescale PostGreSQL Citus Timescale Design Blog Post MIT NYU Stanford SDN Princeton Machine Data Timeseries Data List of Timeseries Databases NoSQL Online Transaction Processing (OLTP) Object Relational Mapper (ORM) Grafana Tableau Kafka When Boring Is Awesome PostGreSQL RDS Google Cloud SQL Azure DB Docker Continuous Aggregates Streaming Replication (..)

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Rockset

NOVEMBER 9, 2021

CDC with Update Timestamps and Kafka One of the simplest ways to implement a CDC solution in both MySQL and Postgres is by using update timestamps. Kafka Connect also has connectors to target systems that can then write these records for you. To simplify this process we can use Kafka Connect.

MySQL 52

MySQL Kafka AWS Database 52