Data Management Principles for Data Science
KDnuggets
SEPTEMBER 10, 2023
Back to Basics: Understanding key data management principles that data scientists should know.
Data Management Related Topics 
Why is Data Management so Important to Data Science?
KDnuggets
AUGUST 16, 2022
High data availability may help power digital transformation, but data management systems are needed to keep that data organizaed and make it accessible. Read this article to see why data management is important to data science.
Data Science 
139
139 Join 37,000+
Insiders
Sign Up for our Newsletter
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Trending Sources
9 Habits Of Effective Data Managers – Running A Data Team
Seattle Data Guy
JULY 2, 2024
In the past few years I have gotten to work with dozens of teams and see how various directors and managers deal… Read more The post 9 Habits Of Effective Data Managers – Running A Data Team appeared first on Seattle Data Guy. All while keeping up with the latest changes in technology.
Data Management 130
130 
Combining Data Management and Data Storytelling to Generate Value
KDnuggets
MAY 23, 2024
A discussion on how to revisit data management from the data storytelling perspective.
Data Management 122
122 
The AI Superhero Approach to Product Management
Speaker: Conrado Morlan
In this engaging and witty talk, industry expert Conrado Morlan will explore how artificial intelligence can transform the daily tasks of product managers into streamlined, efficient processes.
Composable data management at Meta
Engineering at Meta
MAY 22, 2024
In recent years, Meta’s data management systems have evolved into a composable architecture that creates interoperability, promotes reusability, and improves engineering efficiency. Data is at the core of every product and service at Meta. Data is at the core of every product and service at Meta.
Data Management 101
101 
The Top 5 Data Management Tools For Your Projects
KDnuggets
OCTOBER 3, 2023
See what KDnuggets is recommending for the top 5 cutting-edge tools for cloud, ETL, transformation, master data management, and visualization.
Data Management 129
129 
Master Data Management: Common Misconceptions You Should Know
Precisely
OCTOBER 23, 2023
When most people think of master data management, they first think of customers and products. But master data encompasses so much more than data about customers and products. Challenges of Master Data Management A decade ago, master data management (MDM) was a much simpler proposition than it is today.
Data Management 110
110 
Aligning Velox and Apache Arrow: Towards composable data management
Engineering at Meta
FEBRUARY 20, 2024
This new convergence helps Meta and the larger community build data management systems that are unified, more efficient, and composable. Meta’s Data Infrastructure teams have been rethinking how data management systems are designed.
Data Management 108
108 
Back to Basics Week 2: Database, SQL, Data Management and Statistical Concepts
KDnuggets
NOVEMBER 13, 2023
This week, we delve into the vital world of Databases, SQL, Data Management, and Statistical Concepts in Data Science. Welcome back to Week 2 of KDnuggets’ "Back to Basics" series.
Database 119
119 
Transforming Omics Data Management with Databricks Data Intelligence Platform
databricks
SEPTEMBER 30, 2024
This blog explores how new technologies such as Databricks Data Intelligence Platform can pave the way for more effective and efficient multi-omics data management.
Strengthening Cyber Resilience through Efficient Data Management: A Response to M-21-31
databricks
FEBRUARY 22, 2024
For many organizations, log data that security professionals need for effective. In today's environment, proactive cybersecurity is crucial to any public sector agency.
Data Management 110
110 
Understanding Master Data Management (MDM) and Its Role in Data Integrity
Precisely
NOVEMBER 13, 2024
Challenges around data literacy, readiness, and risk exposure need to be addressed – otherwise they can hinder MDM’s success Businesses that excel with MDM and data integrity can trust their data to inform high-velocity decisions, and remain compliant with emerging regulations. Today, you have more data than ever.
Zenlytic Is Building You A Better Coworker With AI Agents
Data Engineering Podcast
MAY 18, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is supported by Code Comments, an original podcast from Red Hat. What do you have planned for the future of AI in the Zenlytic product? Closing Announcements Thank you for listening!
Building 278
278 
Using Trino And Iceberg As The Foundation Of Your Data Lakehouse
Data Engineering Podcast
FEBRUARY 18, 2024
In this episode Dain Sundstrom, CTO of Starburst, explains how the combination of the Trino query engine and the Iceberg table format offer the ease of use and execution speed of data warehouses with the infinite storage and scalability of data lakes. What do you have planned for the future of Trino/Starburst?
Data Lake 262
262 
Transforming Regulatory Data Management and Risk Analytics - The Power of Data Intelligence Platform
databricks
JUNE 28, 2024
Introduction Financial institutions face a demanding environment with complex regulatory examinations and a pressing need for flexible and comprehensive risk management solutions.
Seamless SQL And Python Transformations For Data Engineers And Analysts With SQLMesh
Data Engineering Podcast
JUNE 25, 2023
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management RudderStack helps you build a customer data platform on your warehouse or data lake. Can you describe what SQLMesh is and the story behind it? DataOps is a term that has been co-opted and overloaded.
Data Engineering 225
225 
Troubleshooting Kafka In Production
Data Engineering Podcast
DECEMBER 24, 2023
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.
Kafka 245
245 
Making Email Better With AI At Shortwave
Data Engineering Podcast
APRIL 21, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. Can you describe what Shortwave is and the story behind it? What is the core problem that you are addressing with Shortwave?
Data Lake 182
182 
An Overview Of The Sate Of Data Orchestration In An Increasingly Complex Data Ecosystem
Data Engineering Podcast
SEPTEMBER 10, 2023
In this episode Nick Schrock, creator of Dagster, shares his perspective on the state of data orchestration technology and its application to help inform its implementation in your environment. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.
BI 208
208 
Practical First Steps In Data Governance For Long Term Success
Data Engineering Podcast
JUNE 2, 2024
In this episode she shares the practical steps to implementing a data governance practice in your organization, and the pitfalls to avoid. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Are there any trends that concern you?
Data Governance 147
147 
Stitching Together Enterprise Analytics With Microsoft Fabric
Data Engineering Podcast
JUNE 23, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Data lakes in various forms have been gaining significant popularity as a unified interface to an organization's analytics. Closing Announcements Thank you for listening!
Data Lake 162
162 
Tackling Real Time Streaming Data With SQL Using RisingWave
Data Engineering Podcast
FEBRUARY 4, 2024
In this episode Yingjun Wu explains how it is architected to power analytical workflows on continuous data flows, and the challenges of making it responsive and scalable. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex.
SQL 173
173 
Pushing The Limits Of Scalability And User Experience For Data Processing WIth Jignesh Patel
Data Engineering Podcast
JANUARY 7, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. What are the open questions today in technical scalability of data engines? What are the open questions today in technical scalability of data engines?
Data Process 147
147 
Ship Smarter Not Harder With Declarative And Collaborative Data Orchestration On Dagster+
Data Engineering Podcast
MARCH 24, 2024
In this episode Pete Hunt, CEO of Dagster labs, outlines these new capabilities, how they reduce the burden on data teams, and the increased collaboration that they enable across teams and business units. Can you describe what the focus of Dagster+ is and the story behind it? What problems are you trying to solve with Dagster+?
Data Lake 162
162 
Being Data Driven At Stripe With Trino And Iceberg
Data Engineering Podcast
JUNE 16, 2024
In this episode Kevin Liu shares some of the interesting features that they have built by combining those technologies, as well as the challenges that they face in supporting the myriad workloads that are thrown at this layer of their data platform. Can you describe what role Trino and Iceberg play in Stripe's data architecture?
Data Lake 147
147 
Surveying The Market Of Database Products
Data Engineering Podcast
OCTOBER 29, 2023
In this episode Tanya Bragin shares her experiences as a product manager for two major vendors and the lessons that she has learned about how teams should approach the process of tool selection. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.
Database 189
189 
Building Linked Data Products With JSON-LD
Data Engineering Podcast
SEPTEMBER 17, 2023
In this episode Brian Platz explains how JSON-LD can be used as a shared representation of linked data for building semantic data products. Can you describe what the term "linked data product" means and some examples of when you might build one? Closing Announcements Thank you for listening!
Building 189
189 
A Roadmap To Bootstrapping The Data Team At Your Startup
Data Engineering Podcast
MAY 28, 2023
Ghalib Suleiman has been on both sides of this equation and joins the show to share his hard-won wisdom about how to start and grow a data team in the early days of company growth. Can you start by sharing your conception of the responsibilities of a data team? When is it more practical to outsource the data work?
Data Lake 162
162 
Establish A Single Source Of Truth For Your Data Consumers With A Semantic Layer
Data Engineering Podcast
APRIL 7, 2024
In this episode Artyom Keydunov, creator of Cube, discusses the evolution and applications of the semantic layer as a component of your data platform, and how Cube provides speed and cost optimization for your data consumers. Can you start by outlining the technical elements of what it means to have a "semantic layer"?
Data Lake 162
162 
Improve Data Quality Through Engineering Rigor And Business Engagement With Synq
Data Engineering Podcast
JUNE 30, 2024
He highlights the role of data teams in modern organizations and how Synq is empowering them to achieve this. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Can you describe what Synq is and the story behind it?
Pipeline-centric 147
147 
Keep Your Data Lake Fresh With Real Time Streams Using Estuary
Data Engineering Podcast
MAY 21, 2023
In this episode David Yaffe and Johnny Graettinger share the story behind the business and technology and how you can start using it today to build a real-time data lake without all of the headache. Can you describe what Estuary is and the story behind it? Stream processing technologies have been around for around a decade.
Data Lake 162
162 
Databricks + Tabular
databricks
JUNE 3, 2024
We are excited to announce that we have agreed to acquire Tabular, Inc, a data management company founded by Ryan Blue, Daniel Weeks.
Data Management 145
145 
The Complete Collection of Data Science Books – Part 1
KDnuggets
MAY 19, 2022
Read the best books on Programming, Statistics, Data Engineering, Web Scraping, Data Analytics, Business Intelligence, Data Applications, Data Management, Big Data, and Cloud Architecture.
Data Science 160
160 
X-Ray Vision For Your Flink Stream Processing With Datorios
Data Engineering Podcast
JUNE 9, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is supported by Code Comments, an original podcast from Red Hat. Data observability has been gaining adoption for a number of years now, with a large focus on data warehouses.
Process 147
147 
Build A Data Lake For Your Security Logs With Scanner
Data Engineering Podcast
JANUARY 28, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?
Data Lake 147
147 
When And How To Conduct An AI Program
Data Engineering Podcast
MARCH 3, 2024
Colleen Tartow has worked across all stages of the data lifecycle, and in this episode she shares her hard-earned wisdom about how to conduct an AI program for your organization. What do you have planned for the future of your work at VAST Data? What do you have planned for the future of your work at VAST Data?
Programming 162
162 
Find Out About The Technology Behind The Latest PFAD In Analytical Database Development
Data Engineering Podcast
FEBRUARY 25, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. This was the core of your recent re-write of the InfluxDB engine. Closing Announcements Thank you for listening!
Database 162
162 
Reducing The Barrier To Entry For Building Stream Processing Applications With Decodable
Data Engineering Podcast
OCTOBER 15, 2023
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.
Process 182
182 
Data Sharing Across Business And Platform Boundaries
Data Engineering Podcast
FEBRUARY 11, 2024
In this episode Andrew Jefferson explains the complexities of building a robust system for data sharing, the techno-social considerations, and how the Bobsled platform that he is building aims to simplify the process. What is the current state of the ecosystem for data sharing protocols/practices/platforms?
Data Lake 147
147 
Modern Customer Data Platform Principles
Data Engineering Podcast
JANUARY 21, 2024
In this episode Tasso Argyros, CEO of ActionIQ, gives a summary of the major epochs in database technologies and how he is applying the capabilities of cloud data warehouses to the challenge of building more comprehensive experiences for end-users through a modern customer data platform (CDP).
Data Lake 147
147 
Designing A Non-Relational Database Engine
Data Engineering Podcast
APRIL 14, 2024
Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is brought to you by Datafold – a testing automation platform for data engineers that prevents data quality issues from entering every part of your data workflow, from migration to dbt deployment.
Building Self Serve Business Intelligence With AI And Semantic Modeling At Zenlytic
Data Engineering Podcast
APRIL 16, 2023
In this episode Paul Blankley and Ryan Janssen explore the power of natural language driven data exploration combined with semantic modeling that enables an intuitive way for everyone in the business to access the data that they need to succeed in their work. Can you describe what Zenlytic is and the story behind it?
An Exploration Of The Composable Customer Data Platform
Data Engineering Podcast
APRIL 9, 2023
In this episode Darren Haken is joined by Tejas Manohar to discuss how Autotrader UK is addressing their customer data needs by building on top of their existing data stack. Can you describe what you mean by a "composable CDP"? What are some of the key ways that it differs from the ways that we think of a CDP today?
Data Lake 147
147 
Let's personalize your content