Data Engineering Podcast

MAY 20, 2021

Summary Data governance is a phrase that means many different things to many different people. This is because it is actually a concept that encompasses the entire lifecycle of data, across all of the people in an organization who interact with it. data stewards, business glossaries, etc.)

Data Governance 100

Data Governance Government Data Warehouse Data Pipeline 100

Data Engineering Podcast

MARCH 9, 2020

Summary Data governance is a complex endeavor, but scaling it to meet the needs of a complex or globally distributed organization requires a well considered and coherent strategy. We have partnered with organizations such as O’Reilly Media, Corinium Global Intelligence, ODSC, and Data Council.

Data Governance 100

Data Governance Government Architecture Data 100

Data Engineering Podcast

FEBRUARY 18, 2024

In this episode Dain Sundstrom, CTO of Starburst, explains how the combination of the Trino query engine and the Iceberg table format offer the ease of use and execution speed of data warehouses with the infinite storage and scalability of data lakes. What do you have planned for the future of Trino/Starburst?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Can you describe your experiences with Kafka?

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Precisely

SEPTEMBER 19, 2024

Key Takeaways: Data integrity is essential for AI success and reliability – helping you prevent harmful biases and inaccuracies in AI models. Robust data governance for AI ensures data privacy, compliance, and ethical AI use. Proactive data quality measures are critical, especially in AI applications.

Data Governance 78

Data Governance Government High Quality Data Datasets 78

Precisely

SEPTEMBER 5, 2023

As this realization grows, businesses are shifting their investments from hardware to technologies that optimize data assets. Master Data Management systems (MDM) play an important role in harmonizing data assets across large and midsize enterprises. How can they contribute their expertise?

Data Governance 52

Data Governance Government Data Management Management 52

Data Engineering Podcast

JUNE 30, 2024

He highlights the role of data teams in modern organizations and how Synq is empowering them to achieve this. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Can you describe what Synq is and the story behind it?

Pipeline-centric 147

Pipeline-centric Engineering Data Lake High Quality Data 147

Precisely

OCTOBER 23, 2023

When most people think of master data management, they first think of customers and products. But master data encompasses so much more than data about customers and products. Challenges of Master Data Management A decade ago, master data management (MDM) was a much simpler proposition than it is today.

Data Management 110

Data Management Management Data Data Integration 110

Data Engineering Podcast

APRIL 21, 2024

Summary Generative AI has rapidly transformed everything in the technology sector. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines.

Data Lake 182

Data Lake High Quality Data Data Pipeline Machine Learning 182

Data Engineering Podcast

JUNE 23, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Data lakes in various forms have been gaining significant popularity as a unified interface to an organization's analytics. Closing Announcements Thank you for listening!

Data Lake 162

Data Lake High Quality Data Hadoop Machine Learning 162

Data Engineering Podcast

JUNE 16, 2024

In this episode Kevin Liu shares some of the interesting features that they have built by combining those technologies, as well as the challenges that they face in supporting the myriad workloads that are thrown at this layer of their data platform. Can you describe what role Trino and Iceberg play in Stripe's data architecture?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

Data Engineering Podcast

NOVEMBER 16, 2020

In this episode CEO and co-founder of Isima Darshan Rawal explains how the biOS platform is architected to enable ease of use, the challenges that were involved in building an entirely new system from scratch, and how it can integrate with the rest of your data platform to allow for incremental adoption. What is the story behind the name?

Data Management 100

Data Management Management BI Business Intelligence 100

Data Engineering Podcast

FEBRUARY 4, 2024

In this episode Yingjun Wu explains how it is architected to power analytical workflows on continuous data flows, and the challenges of making it responsive and scalable. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex.

SQL 173

SQL Data Lake High Quality Data Data Pipeline 173

Data Engineering Podcast

MARCH 24, 2024

In this episode Pete Hunt, CEO of Dagster labs, outlines these new capabilities, how they reduce the burden on data teams, and the increased collaboration that they enable across teams and business units. Can you describe what the focus of Dagster+ is and the story behind it? What problems are you trying to solve with Dagster+?

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Precisely

MAY 18, 2023

According to IDC , 50% of enterprises in the United States say that using data and intelligence strategically to create competitive differentiation is critical to running a successful digital business. Data governance has emerged as a key success factor for companies aiming to innovate, improve efficiency, and drive competitive advantage.

Data Governance 52

Data Governance Government Finance Data 52

Knowledge Hut

APRIL 20, 2023

Data governance refers to the set of policies, procedures, mix of people and standards that organisations put in place to manage their data assets. It involves establishing a framework for data management that ensures data quality, privacy, security, and compliance with regulatory requirements.

Data Governance 59

Data Governance Government Data Cleanse Data Security 59

Data Engineering Podcast

JUNE 9, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is supported by Code Comments, an original podcast from Red Hat. Data observability has been gaining adoption for a number of years now, with a large focus on data warehouses.

Process 147

Process Data Lake High Quality Data Machine Learning 147

Data Engineering Podcast

JANUARY 7, 2024

Summary Data processing technologies have dramatically improved in their sophistication and raw throughput. Unfortunately, the volumes of data that are being generated continue to double, requiring further advancements in the platform capabilities to keep up. What do you have planned for the future of your academic research?

Data Process 147

Data Process Process Data Lake High Quality Data 147

Data Engineering Podcast

APRIL 7, 2024

Different roles and tasks in the business need their own ways to access and analyze the data in the organization. In order to enable this use case, while maintaining a single point of access, the semantic layer has evolved as a technological solution to the problem. What do you have planned for the future of Cube?

Data Lake 162

Data Lake High Quality Data BI Data Workflow 162

Precisely

AUGUST 8, 2023

Data governance is rapidly shifting from a leading-edge practice to a must-have framework for today’s enterprises. Although the term has been around for several decades, it is only now emerging as a widespread practice, as organizations experience the pain and compliance challenges associated with ungoverned data.

Data Governance 52

Data Governance Government Data Education 52

Precisely

JANUARY 5, 2023

For some companies that do have a formal strategy, that strategy may be little more than a technical exercise, the primary purpose of which is to lay out the nuts and bolts of data management, compliance, and similar baseline requirements. Data governance plays a critical role in any effective data strategy.

Data Governance 52

Data Governance Government Data Raw Data 52

Data Engineering Podcast

MARCH 3, 2024

Summary Artificial intelligence technologies promise to revolutionize business and produce new sources of value. Colleen Tartow has worked across all stages of the data lifecycle, and in this episode she shares her hard-earned wisdom about how to conduct an AI program for your organization.

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

FEBRUARY 11, 2024

In this episode Andrew Jefferson explains the complexities of building a robust system for data sharing, the techno-social considerations, and how the Bobsled platform that he is building aims to simplify the process. What is the current state of the ecosystem for data sharing protocols/practices/platforms?

Data Lake 147

Data Lake High Quality Data Government Data Pipeline 147

Data Engineering Podcast

JANUARY 21, 2024

In this episode Tasso Argyros, CEO of ActionIQ, gives a summary of the major epochs in database technologies and how he is applying the capabilities of cloud data warehouses to the challenge of building more comprehensive experiences for end-users through a modern customer data platform (CDP).

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Snowflake

SEPTEMBER 27, 2023

At Snowflake, we are dedicated to helping our customers effectively mobilize their data while upholding stringent standards for compliance and data governance. Today, we are thrilled to announce the general availability of the Data Governance Interface in Snowsight.

Data Governance 64

Data Governance Government SQL Database 64

Data Engineering Podcast

MAY 12, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is supported by Code Comments, an original podcast from Red Hat. Code Comments Podcast Logo]([link] Putting new technology to use is an exciting prospect. Want to see Starburst in action?

Management 147

Management Data Lake High Quality Data Machine Learning 147

Data Engineering Podcast

DECEMBER 31, 2023

In this episode Andrey Korchack, CTO of fintech startup Monite, discusses the complexities of designing and implementing a data platform in that sector. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex.

Designing 130

Designing Data Lake High Quality Data SQL 130

Precisely

AUGUST 29, 2024

Data observability continuously monitors data pipelines and alerts you to errors and anomalies. Data governance ensures AI models have access to all necessary information and that the data is used responsibly in compliance with privacy, security, and other relevant policies. stored: where is it located?

Data Governance 52

Data Governance Government High Quality Data Datasets 52

Jesse Anderson

NOVEMBER 15, 2022

My guest this week is Kulani Likotsi , the Head of Data Management and Data Governance at one of the four biggest banks in Africa. She’s had a rising career journey going from an analyst, to a Business Intelligence developer, to the data warehouse team, to the data governance team.

Data Governance 130

Data Governance Government Banking Business Intelligence 130

Data Engineering Podcast

JANUARY 28, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 147

Data Lake Building High Quality Data AWS 147

Monte Carlo

JANUARY 24, 2024

Data is among your company’s most valuable commodities, but only if you know how to manage it. More data, more access to data, and more regulations mean data governance has become a higher-stakes game. At the same time, data governance technologies are growing more intelligent.

Data Governance 52

Data Governance Government Data Lake Data Architecture 52

Precisely

SEPTEMBER 8, 2023

According to a recent report on data integrity trends from Drexel University’s LeBow College of Business , 41% reported that data governance was a top priority for their data programs. Automating functions in support of data governance provides a range of important benefits.

Data Governance 52

Data Governance Government Data Big Data 52

Data Engineering Podcast

APRIL 14, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is brought to you by Datafold – a testing automation platform for data engineers that prevents data quality issues from entering every part of your data workflow, from migration to dbt deployment.

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Precisely

SEPTEMBER 6, 2023

.” Poor data quality impedes the success of data programs, hampers data integration efforts, limits data integrity causing big data governance challenges. To truly succeed in an increasingly data-driven world, organizations need data governance. The results are clear.

Data Governance 52

Data Governance Big Data Government Unstructured Data 52

AltexSoft

MARCH 2, 2023

As the amount of enterprise data continues to surge, businesses are increasingly recognizing the importance of data governance — the framework for managing an organization’s data assets for accuracy, consistency, security, and effective use. What is data governance? billion in 2020 to $5.28

Data Governance 52

Data Governance Government Programming Healthcare 52

Cloudera

MAY 14, 2024

Hybrid cloud plays a central role in many of today’s emerging innovations—most notably artificial intelligence (AI) and other emerging technologies that create new business value and improve operational efficiencies. But getting there requires data, and a lot of it. What do we mean by ‘true’ hybrid? Let’s dive deeper.

Cloud 104

Cloud Data Governance Unstructured Data Data Architecture 104

Precisely

JULY 19, 2023

Data governance is fast becoming a business imperative. Many top executives and line-of-business managers lack a clear understanding of the benefits of data governance. Data governance plays a critical role in risk management and compliance as well. How can you within your organization?

Data Governance 52

Data Governance Government Building Data 52