Confluent

NOVEMBER 20, 2020

Building data pipelines isn’t always straightforward. The gap between the shiny “hello world” examples of demos and the gritty reality of messy data and imperfect formats is sometimes all too […].

Cloud 139

Cloud Data Pipeline Data Building 139

Striim

APRIL 18, 2025

How Organizations Can Overcome Data Quality and Availability Challenges Many businesses are shifting toward real-time data pipelines to ensure their AI and analytics strategies are built on reliable information. Enabling AI & ML with Adaptive Data Pipelines AI models require ongoing updates to stay relevant.

High Quality Data 52

High Quality Data Business Intelligence Unstructured Data Data Pipeline 52

Snowflake

MARCH 2, 2023

Snowflake enables organizations to be data-driven by offering an expansive set of features for creating performant, scalable, and reliable data pipelines that feed dashboards, machine learning models, and applications. But before data can be transformed and served or shared, it must be ingested from source systems.

Kafka 137

Kafka Data Ingestion Data Pipeline Cloud Storage 137

Snowflake

APRIL 9, 2025

Teams can deploy and manage experiments using data available in Snowflake in real time, without having to deal with access to a third-party platform, exfiltrating sensitive conversion data or building complex data pipelines to get the data they need.

Pharmaceutical 98

Pharmaceutical Manufacturing Data Ingestion SQL 98

Datakin

AUGUST 10, 2021

Blog An instant demo of data lineage is worth a thousand words Written by Ross Turk on August 10, 2021 They say that a picture is worth a thousand words. If you’ve ever tried to describe how all the jobs in your data pipeline are interrelated using just words, I am sure it wasn’t easy.

Data Pipeline 52

Data Pipeline Metadata Data IT 52

Confluent

JUNE 22, 2022

How to use data pipelines, unlock the benefits of real-time data flow, and achieve seamless data streaming and analytics at scale with Confluent.

Data Pipeline 52

Data Pipeline Kafka Data 52

Silectis

JANUARY 22, 2021

For those using a robust analytics database, such as the Snowflake® Data Cloud , adding the power of a data engineering platform can help maximize the value you’re getting out of that database. Magpie Fills in the Gaps for Better Data Engineering And we’re not talking about just ETL (extract, transform, load). Magpie can help.

Data Engineer 52

Data Engineer Data Engineering Engineering Data Warehouse 52

Monte Carlo

MARCH 19, 2025

Monte Carlo and Databricks double-down on their partnership, helping organizations build trusted AI applications by expanding visibility into the data pipelines that fuel the Databricks Data Intelligence Platform. This comprehensive visibility helps teams identify and resolve data issues before they cascade into AI failures.

Unstructured Data 52

Unstructured Data Data Pipeline High Quality Data Banking 52

Striim

AUGUST 14, 2024

When implemented effectively, smart data pipelines seamlessly integrate data from diverse sources, enabling swift analysis and actionable insights. They empower data analysts and business users alike by providing critical information while protecting sensitive production systems. What is a Smart Data Pipeline?

Data Pipeline 52

Data Pipeline Data Architecture Transportation 52

Monte Carlo

MARCH 6, 2025

With their extended partnership, data + AI observability leader and the Data AI Cloud bring reliability to structured and unstructured data pipelines in Snowflake Cortex AI. Read on for more details and find out how were thinking about unstructured data observability for AI. Why observability for unstructured data?

Unstructured Data 52

Unstructured Data Data Pipeline Coding Data 52

Data Engineering Podcast

DECEMBER 28, 2022

Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Monitoring data quality, tracing incidents, and testing changes can be daunting and often takes hours to days or even weeks. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Data Engineering Podcast

DECEMBER 25, 2022

Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Monitoring data quality, tracing incidents, and testing changes can be daunting and often takes hours to days or even weeks. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Striim

OCTOBER 11, 2024

A well-executed data pipeline can make or break your company’s ability to leverage real-time insights and stay competitive. Thriving in today’s world requires building modern data pipelines that make moving data and extracting valuable insights quick and simple. What is a Data Pipeline?

Data Pipeline 52

Data Pipeline MongoDB Unstructured Data Data Lake 52

Monte Carlo

APRIL 1, 2024

And now, from the mind of Barr Moses, comes the historic next children’s literary classic: Mastering Data Quality And Your ABCs. After all, in the age of virtual reality, generative AI, and cyber trucks, why shouldn’t children also learn how to write their first dbt test or spin up their first data observability solution? .

Data Pipeline 116

Data Pipeline Media Education Data 116

Ascend.io

OCTOBER 28, 2024

Tools like Python’s requests library or ETL/ELT tools can facilitate data enrichment by automating the retrieval and merging of external data. Read More: Discover how to build a data pipeline in 6 steps Data Integration Data integration involves combining data from different sources into a single, unified view.

Raw Data 52

Raw Data Datasets Aggregated Data Data Pipeline 52

Databand.ai

SEPTEMBER 9, 2022

How to analyze and resolve data pipeline incidents in Databand Niv Sluzki 2022-09-09 13:00:12 A data pipeline failure can cripple your downstream data flows. Whether it failed to start or quit unexpectedly, you need to know immediately if there is a pipeline incident.

Data Pipeline 52

Data Pipeline Datasets AWS Data 52

Monte Carlo

NOVEMBER 26, 2024

It’s important to be able to talk about them, but in reality, no one has been able to deploy them and no one has had any success outside of a demo. We’re going to see an explosion in the total number of pipelines but with much smaller data volumes.” But the more pipelines expand, the more difficult data quality becomes.

Data Engineer 105

Data Engineer Data Engineering Engineering Unstructured Data 105

Snowflake

JUNE 10, 2024

” —David Webb, Data Architect at Travelpass Build modern data pipelines with Snowflake Python APIs Snowflake’s latest suite of Python APIs (GA soon) simplifies the data pipeline development process with Python.

Python 119

Python Data Pipeline SQL Database 119

Databand.ai

SEPTEMBER 19, 2022

How to create data pipeline and data quality SLA alerts in Databand Helen Soloveichik 2022-09-20 01:49:30 Data engineers often get inundated by alerts from data issues. Databand helps fix this problem by breaking through noisy alerts with focused alerting and routing when a data pipeline and quality issues occur.

Data Pipeline 52

Data Pipeline Datasets Data Data Engineer 52

Monte Carlo

APRIL 28, 2025

Thats where data observability comes in. Tools like Monte Carlo monitor your data pipelines and flag issueslike broken jobs, missing records, or sudden spikes before they mess up your reports. Thats how you move from just working with data to actually making confident, smart decisions based on it.

Metadata 52

Metadata Hadoop Data SQL 52

Striim

MARCH 21, 2025

Striim customers often utilize a single streaming source for delivery into Kafka, Cloud Data Warehouses, and cloud storage, simultaneously and in real-time. Building streaming data pipelines shouldnt require custom coding Building data pipelines and working with streaming data should not require custom coding.

Process 52

Process Data Warehouse Kafka Data Pipeline 52

Striim

APRIL 10, 2025

Seamless Integration for Instant Insight: To maximize the benefits of real-time analytics, organizations need platforms that can seamlessly integrate AI models into their data pipelines. Striim provides the architecture to apply trained models to incoming data as it flows through the system.

Data Analytics 52

Data Analytics Algorithm Datasets Data 52

DataKitchen

FEBRUARY 17, 2025

Current open-source frameworks like YAML-based Soda Core, Python-based Great Expectations, and dbt SQL are frameworks to help speed up the creation of data quality tests. They are all in the realm of software, domain-specific language to help you write data quality tests. Download Now Request Demo

SQL 73

SQL Python Government Data Engineer 73

Striim

JANUARY 30, 2025

This approach delivers meaningful insights the moment data arrives, supported by continuous learning algorithms that adapt models dynamically to evolving conditions. By integrating AI/ML models directly into streaming data pipelines, organizations can detect anomalies, predict cascading impacts, and execute real-time interventions.

Systems 52

Systems Management Hospitality Healthcare 52

Ascend.io

APRIL 27, 2023

Going into the Data Pipeline Automation Summit 2023, we were thrilled to connect with our customers and partners and share the innovations we’ve been working on at Ascend. The summit explored the future of data pipeline automation and the endless possibilities it presents.

Data Pipeline 52

Data Pipeline Pipeline-centric Data Validation Data Engineer 52

Christophe Blefari

JULY 13, 2024

kyutai released Moshi — Moshi is a "voice-enabled AI" The team as kyutai developed the model with an audio interface-first with an audio language model, which make the conversation with the AI more real (demo at 5:00 min) as it can interrupt you or kinda "think" (meaning for predict the next audio segment) while it speaks.

Kafka 130

Kafka AWS Data Database 130

Striim

FEBRUARY 26, 2025

With this setting, the connector initially reads all the data from selected objects and then switches to incremental loading, ensuring ongoing updates are seamlessly captured. This flexibility makes it easy to keep your data pipeline running efficiently. Ready to power your business with real-time data?

Data Consolidation 40

Data Consolidation Data Workflow Data Pipeline Data 40

Data Engineering Podcast

JULY 17, 2022

Go to dataengineeringpodcast.com/atlan today to learn more about how Atlan’s active metadata platform is helping pioneering data teams like Postman, Plaid, WeWork & Unilever achieve extraordinary things with metadata and escape the chaos. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code.

Data Management 130

Data Management Management Metadata MongoDB 130

Striim

FEBRUARY 26, 2025

Bi-Directional Pipelines: Combining the Salesforce CDC Reader with Striims Snowflake CDC Reader creates the fastest bi-directional pipelines, keeping both Salesforce and Snowflake in sync. Unified Platform: Striim integrates Salesforce with other databases, providing a unified platform for handling all your Salesforce data pipelines.

BI 40

BI Cloud Data Pipeline Data Integration 40

Data Engineering Podcast

DECEMBER 18, 2022

Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Monitoring data quality, tracing incidents, and testing changes can be daunting and often takes hours to days or even weeks. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 100

Data Lake Data Warehouse Data Pipeline MongoDB 100

Data Engineering Podcast

JUNE 19, 2022

Go to dataengineeringpodcast.com/atlan today to learn more about how Atlan’s active metadata platform is helping pioneering data teams like Postman, Plaid, WeWork & Unilever achieve extraordinary things with metadata and escape the chaos. Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Data Engineering Podcast

NOVEMBER 6, 2022

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. Sign up free at dataengineeringpodcast.com/rudder Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code.

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

Data Engineering Podcast

NOVEMBER 20, 2022

Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Monitoring data quality, tracing incidents, and testing changes can be daunting and often takes hours to days or even weeks. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 130

Data Lake Data Ingestion MongoDB MySQL 130

Cloudera

MARCH 14, 2023

Data leaders will be able to simplify and accelerate the development and deployment of data pipelines, saving time and money by enabling true self service. It is no secret that data leaders are under immense pressure. For more information or to see a demo, go to the DataFlow Product page.

Designing 80

Designing Data Pipeline Data Governance Government 80

Towards Data Science

DECEMBER 16, 2024

Its important to be able to talk about them, no one has had any success outside of a demo. Pipelines are expandingbut quality coverage isnt(Tomasz) At a dinner with a bunch of heads of AI, I asked how many people were satisfied with the quality of the outputs, and no one raised their hands.

Unstructured Data 80

Unstructured Data Data Food Data Engineering 80

Data Engineering Podcast

DECEMBER 4, 2022

Modern data teams are dealing with a lot of complexity in their data pipelines and analytical code. Monitoring data quality, tracing incidents, and testing changes can be daunting and often takes hours to days or even weeks. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

ThoughtSpot

JUNE 23, 2023

AI-assisted data modeling on shared data workloads Data sharing is critical to inform decision making across the organization. Snowflake eliminates the data sharing complexities of traditional data pipelines —making data secure, governed, and easily ready to query.

Cloud 105

Cloud Programming Language Government Data Security 105