The Modern Data Company

MAY 8, 2023

Data lakes, data warehouses, data hubs, data lakehouses, and data operating systems are data management and storage solutions designed to meet different needs in data analytics, integration, and processing. This feature allows for a more flexible exploration of data.

Data Management 52

Data Management Data Lake Management Data Governance 52

Data Engineering Podcast

DECEMBER 28, 2022

In this episode he shares his thoughts on the strategic and tactical elements of moving your work as a data professional from being task-oriented to being product-oriented and the long term improvements in your productivity that it provides. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Data Engineering Podcast

DECEMBER 25, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode. or any other destination you choose.

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Cloudera

NOVEMBER 21, 2024

Cloudera customers benefit from enterprise-secured tools to build collaborative sandboxes, empowering data engineers, data scientists, and extended data practitioner teams that need insights to drive decisions.

Pipeline-centric 56

Pipeline-centric Data Engineer Data Engineering Engineering 56

Data Engineering Podcast

NOVEMBER 20, 2022

In this episode CEO and founder Salma Bakouk shares her views on the causes and impacts of "data entropy" and how you can tame it before it leads to failures. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows.

Data Lake 130

Data Lake Data Ingestion MongoDB Google Cloud 130

Snowflake

APRIL 18, 2024

With Snowflake, security teams don’t have to work around these data retention windows. Instead, all data is always accessible for analysis, which simplifies cost planning and the data management strategy. A security data lake eliminates data silos by removing limits on ingest and retention.

Data Lake 83

Data Lake Data Ingestion Bytes Cloud Computing 83

Data Engineering Podcast

DECEMBER 4, 2022

In this episode Arjun Narayan explains how the technical barriers to adopting real-time data in your analytics and applications have become surmountable by organizations of all sizes. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

DECEMBER 11, 2022

Summary One of the most critical aspects of software projects is managing its data. Managing the operational concerns for your database can be complex and expensive, especially if you need to scale to large volumes of data, high traffic, or geographically distributed usage. or any other destination you choose.

Database 100

Database MySQL Data Lake MongoDB 100

Data Engineering Podcast

DECEMBER 18, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you're ready to build your next pipeline, or want to test out the projects you hear about on the show, you'll need somewhere to deploy it, so check out our friends at Linode. or any other destination you choose.

Data Lake 100

Data Lake Data Warehouse Data Pipeline MongoDB 100

Data Engineering Podcast

NOVEMBER 27, 2022

He also discusses the improvements that have been incorporated into FeatureBase to simplify integration with the rest of your data stack, and the SQL interface that was added to make working with the product easier. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. or any other destination you choose.

Data Lake 100

Data Lake Data Warehouse MongoDB Data Pipeline 100

The Modern Data Company

JULY 24, 2023

Delivering Use Cases through Chained Data Products Predictive Maintenance : Chaining data products such as IoT sensors, data lakes, and predictive analytics models can enable organizations to implement predictive maintenance use cases.

Data Lake 85

Data Lake Transportation Algorithm Data 85

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode she shares the story behind the project, the details of how it is implemented, and how you can use it for your own data projects. RudderStack helps you build a customer data platform on your warehouse or data lake. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

MongoDB 130

MongoDB Scala MySQL Machine Learning 130

Data Engineering Podcast

OCTOBER 30, 2022

In this episode he shares his experiences working with organizations to adopt analytics engineering patterns and the ways that Optimus and dbt were combined to let data analysts deliver insights without the roadblocks of complex pipeline management. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Engineering 100

Engineering MongoDB Scala MySQL 100

Data Engineering Podcast

NOVEMBER 13, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

MongoDB 100

MongoDB Google Cloud Scala MySQL 100

The Modern Data Company

JULY 24, 2023

Delivering Use Cases through Chained Data Products Predictive Maintenance : Chaining data products such as IoT sensors, data lakes, and predictive analytics models can enable organizations to implement predictive maintenance use cases. Schedule a demo PDF VERSION PDF VERSION Schedule a demo

Data Lake 52

Data Lake Transportation Algorithm Data 52

The Modern Data Company

JULY 24, 2023

Delivering Use Cases through Chained Data Products Predictive Maintenance : Chaining data products such as IoT sensors, data lakes, and predictive analytics models can enable organizations to implement predictive maintenance use cases.

Data Lake 52

Data Lake Transportation Algorithm Data 52

Striim

SEPTEMBER 11, 2024

This method is advantageous when dealing with structured data that requires pre-processing before storage. Conversely, in an ELT-based architecture, data is initially loaded into storage systems such as data lakes in its raw form. Would the data be stored on cloud or on-premises?’

Data Pipeline 98

Data Pipeline Designing Data Lake Data Warehouse 98

Data Engineering Podcast

MAY 1, 2022

He describes how the platform is architected, the challenges related to selling cloud technologies into enterprise organizations, and how you can adopt Matillion for your own workflows to reduce the maintenance burden of data integration workflows. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold.

Data Warehouse 100

Data Warehouse Data Integration Cloud Google Cloud 100

Data Engineering Podcast

SEPTEMBER 23, 2018

Using the metaphor of a museum curator carefully managing the precious resources on display and in the vaults, he discusses the various layers of an enterprise data strategy. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

Data Lake 100

Data Lake Data Warehouse Data Architecture Architecture 100

Data Engineering Podcast

APRIL 24, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. Missing data?

Data Warehouse 100

Data Warehouse Data Lake Data Pipeline BI 100

Data Engineering Podcast

DECEMBER 21, 2020

If you are starting down the path of implementing a data governance strategy then this episode will provide a great overview of what is involved. If you hand a book to a new data engineer, what wisdom would you add to it? What is data governance? If you hand a book to a new data engineer, what wisdom would you add to it?

Data Governance 130

Data Governance Government Data Lake Banking 130

Data Engineering Podcast

FEBRUARY 24, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

IT 100

IT Data Lake Data Pipeline Media 100

Data Engineering Podcast

JANUARY 4, 2021

Summary As more organizations are gaining experience with data management and incorporating analytics into their decision making, their next move is to adopt machine learning. Monte Carlo’s end-to-end Data Observability Platform monitors and alerts for data issues across your data warehouses, data lakes, ETL, and business intelligence.

Python 100

Python Machine Learning Computer Science Data Lake 100

The Modern Data Company

APRIL 15, 2024

Understands how different pieces of data (books) relate to each other, helping users find related information. Keeps the library orderly, adjusting as new data arrives. Tracks key performance indicators to understand the use and value of the data. Manages information about data access and monitors data quality.

Government 52

Government Metadata Data Data Management 52

Data Engineering Podcast

JANUARY 11, 2021

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

PostgreSQL 100

PostgreSQL Python Computer Science Data Lake 100

Data Engineering Podcast

SEPTEMBER 30, 2018

This is a great episode to listen to for ideas on how to organize a data engineering organization. Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline you’ll need somewhere to deploy it, so check out Linode.

Building 100

Building Data Lake AWS Machine Learning 100

Data Engineering Podcast

MARCH 16, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Building 100

Building Data Warehouse NoSQL Data Lake 100

Data Engineering Podcast

SEPTEMBER 9, 2018

They also explain some of the types of data that you can use with Chaos Search, how to load it into S3, and when you might want to choose it over Amazon Athena for our serverless data analysis. Request a demo at dataengineeringpodcast.com/metis-machine to learn more about how Metis Machine is operationalizing data science.

IT 100

IT PostgreSQL Scala AWS 100

Data Engineering Podcast

MARCH 2, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Kafka 100

Kafka Process PostgreSQL MySQL 100

Striim

OCTOBER 11, 2024

This technical approach is essential for maintaining data consistency and accuracy across the pipeline. Self-Service Management Modern data pipelines facilitate seamless integration between a wide range of tools, including data integration platforms, data warehouses, data lakes, and programming languages.

Data Pipeline 52

Data Pipeline MongoDB Unstructured Data Data Lake 52

Data Engineering Podcast

JULY 8, 2019

It was interesting to learn about some of the custom data types and performance optimizations that are included. Contact Info Robert LinkedIn hodgesrm on GitHub Alexander alex-zaitsev on GitHub LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Warehouse 100

Data Warehouse MySQL Hadoop Data Lake 100

Monte Carlo

JUNE 14, 2022

This fanfare turned out to be justified as Slootman, co-founder Benoit Dageville, and Christian Kleinerman took the stage to reveal a series of announcements that promise to disrupt the data management landscape – and beyond. We’ve written previously about how building an external data product is hard. That story?

Cloud 52

Cloud Data Ingestion Python Government 52

The Modern Data Company

JANUARY 17, 2023

Because DataOS connects to everything in the data stack, no data goes unnoticed. Leaders Can Easily Bring the CDP Under Federated Governance CDPs ingest data through both governed and ungoverned channels. To find out more about how DataOS can transform your CDP, schedule a quick call with one of our data experts.

Metadata 59

Metadata Government Data Lake Data 59

Ascend.io

MAY 23, 2023

Already in 2016, IBM estimated the cost of bad data to be over three trillion dollars, and that was before the chaos of data lakes emerged and orphaned datasets began to swamp the land. To see these capabilities in action, check out this brief demo. How can you up your game?

Datasets 52

Datasets Data Pipeline Metadata Database 52

AltexSoft

OCTOBER 8, 2021

The bad news is, integrating data can become a tedious task, especially when done manually. Luckily, there are various data integration tools that support automation and provide a unified data view for more efficient data management. Data integration process. So, why is data integration such a big deal?

Data Integration 52

Data Integration Hadoop Data Warehouse Data Lake 52

AltexSoft

SEPTEMBER 10, 2021

Consisting of the same steps as in ETL, ELT changes the sequence — it first extracts raw data from sources and loads it into a target source, where transformation happens as and when required. The target system for ELT is usually a data lake or cloud data warehouse. Key types of data integration.

Data Integration 52

Data Integration Data Consolidation Data Warehouse BI 52

The Modern Data Company

MARCH 1, 2024

For today’s Chief Data Officers (CDOs) and data teams, the struggle is real. We’re drowning in data yet thirsting for actionable insights. We need a new approach, a paradigm shift that delivers data with the agility and efficiency of a speedboat – enter Data Products.

Database-centric 40

Database-centric Data Lake Government Retail 40