DareData

JANUARY 30, 2023

Our goal is to help data scientists better manage their models deployments or work more effectively with their data engineering counterparts, ensuring their models are deployed and maintained in a robust and reliable way. DigDag: An open-source orchestrator for data engineering workflows.

Data Engineering 52

Data Engineering Data Engineer NoSQL Engineering 52

Rockset

AUGUST 30, 2021

A Quick Primer on Indexing in Rockset Rockset allows users to connect real-time data sources — data streams (Kafka, Kinesis), OLTP databases (DynamoDB, MongoDB, MySQL, PostgreSQL) and also data lakes (S3, GCS) — using built-in connectors. You can also optionally use WHERE clauses to filter out data.

SQL 52

SQL Kafka MongoDB MySQL 52

Striim

OCTOBER 11, 2024

Striim supported American Airlines by implementing a comprehensive data pipeline solution to modernize and accelerate operations. To achieve this, the TechOps team implemented a real-time data hub using MongoDB, Striim, Azure, and Databricks to maintain seamless, large-scale operations.

Data Pipeline 52

Data Pipeline MongoDB Unstructured Data Data Lake 52

ProjectPro

OCTOBER 28, 2015

Apache Hadoop is synonymous with big data for its cost-effectiveness and its attribute of scalability for processing petabytes of data. Data analysis using hadoop is just half the battle won. Getting data into the Hadoop cluster plays a critical role in any big data deployment. then you are on the right page.

ETL Tools 52

ETL Tools Hadoop Relational Database Unstructured Data 52

Rockset

OCTOBER 4, 2022

Aggregator-Leaf-Tailer architecture used by Rockset In the following sections, we examine how some of these architectural differences impact the capabilities of Rockset and ClickHouse. This means users need to configure their streams to batch data ahead of loading into ClickHouse.

MySQL 52

MySQL Kafka Aggregated Data Architecture 52

ProjectPro

AUGUST 24, 2021

Data Engineering Project for Beginners If you are a newbie in data engineering and are interested in exploring real-world data engineering projects, check out the list of data engineering project examples below. This big data project discusses IoT architecture with a sample use case.

Data Engineering 52

Data Engineering Data Engineer Coding Project 52

AltexSoft

MARCH 14, 2023

Also, there are NoSQL databases that can be home to all sorts of data, including unstructured and semi-structured (images, PDF files, audio, JSON, etc.) Some popular databases are Postgres and MongoDB. Joining: combining data from multiple sources based on a common key or attribute.

IT 59

IT Data Warehouse Data Governance Data Lake 59