Data Engineering Podcast

FEBRUARY 25, 2024

Can you describe the operational/architectural aspects of building a full data engine on top of the FDAP stack? What are some of the other tools/technologies that can benefit from some or all of the pieces of the FDAP stack? Can you describe the operational/architectural aspects of building a full data engine on top of the FDAP stack?

Database 162

Database Technology Data Lake High Quality Data 162

Snowflake

MARCH 31, 2025

Snowflake ML now also supports the ability to generate and use synthetic data, now in public preview. All customer accounts are automatically provisioned to have access to default CPU and GPU compute pools that are only in use during an active notebook session and automatically suspended when inactive. With over $5.5

Healthcare 96

Healthcare Medical Government Food 96

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. However, they require a strong data foundation to be effective.

Data Analytics 72

Data Analytics Data Governance Data Integration Government 72

phData: Data Engineering

NOVEMBER 1, 2024

In an effort to better understand where data governance is heading, we spoke with top executives from IT, healthcare, and finance to hear their thoughts on the biggest trends, key challenges, and what insights they would recommend. ) Get the Trendbook What is the Impact of Data Governance on GenAI?

Government 52

Government Data Governance Finance Metadata 52

Cloudera

AUGUST 4, 2021

And if data security tops IT concerns, data governance should be their second priority. Not only is it critical to protect data, but data governance is also the foundation for data-driven businesses and maximizing value from data analytics. But it’s still not easy. But it’s still not easy.

Data Governance 86

Data Governance Government Metadata Data Security 86

Snowflake

NOVEMBER 11, 2024

This is not surprising when you consider all the benefits, such as reducing complexity [and] costs and enabling zero-copy data access (ideal for centralizing data governance). Those requirements can be fulfilled by leveraging cloud infrastructure and services.

Banking 98

Banking Finance Retail Food 98

Cloudera

SEPTEMBER 23, 2022

In a recent blog, Cloudera Chief Technology Officer Ram Venkatesh described the evolution of a data lakehouse, as well as the benefits of using an open data lakehouse, especially the open Cloudera Data Platform (CDP). Modern data lakehouses are typically deployed in the cloud.

Data Governance 109

Data Governance Government Amazon Web Services Cloud Computing 109

Snowflake

MARCH 19, 2025

Hear from technology and industry experts about the ways in which leading retail and consumer goods companies are building connected consumer experiences with Snowflakes AI Data Cloud and maximizing the potential of AI. Discovery are redefining media measurement through Data Clean Rooms.

Retail 95

Retail Media Entertainment Unstructured Data 95

Snowflake

NOVEMBER 26, 2024

Data becomes distributed across multiple platforms; different teams end up using different tools. In essence, that was the story of WHOOP , the Boston-based wearable technology company aimed at enhancing human performance and endorsed by superstar athletes such as LeBron James and Cristiano Ronaldo. million in cost savings annually.

Data Warehouse 105

Data Warehouse Cloud PostgreSQL Hadoop 105

Precisely

OCTOBER 31, 2024

Key Takeaways: Data mesh is a decentralized approach to data management, designed to shift creation and ownership of data products to domain-specific teams. Data fabric is a unified approach to data management, creating a consistent way to manage, access, and share data across distributed environments.

Data Architecture 69

Data Architecture Architecture Metadata Government 69

Precisely

SEPTEMBER 19, 2024

Key Takeaways: Data integrity is essential for AI success and reliability – helping you prevent harmful biases and inaccuracies in AI models. Robust data governance for AI ensures data privacy, compliance, and ethical AI use. Proactive data quality measures are critical, especially in AI applications.

Data Governance 78

Data Governance Government High Quality Data Datasets 78

Precisely

JANUARY 16, 2024

As the role of data and data-driven decision-making increases and as the overall volume and velocity of available data grows, data governance is evolving to meet a changing set of business requirements. What are the biggest trends in data governance for 2024?

Data Governance 69

Data Governance Government Metadata Data 69

Data Engineering Podcast

FEBRUARY 18, 2024

For someone who is interested in building a data lakehouse with Trino and Iceberg, how does that influence their selection of other platform elements? What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Snowflake

APRIL 7, 2025

Our leadership combines decades of experience in product safety and quality management with cutting-edge expertise in AI, data science and regulatory insights. We are inspired by the transformative potential of technology to solve persistent challenges in product quality and compliance that we experienced firsthand.

Food 85

Food Data Transparency Software Engineer Software Engineering 85

Snowflake

FEBRUARY 3, 2025

Laying the groundwork: Creating solid data foundations While generative AI holds immense promise, achieving its full potential depends on having a solid data foundation. High-quality, accessible and well-governed data enables organizations to realize the efficiency and productivity gains executives seek.

Government 91

Government Data Governance Accessibility Accessible 91

Precisely

DECEMBER 8, 2023

Together, these forces have pushed companies to accelerate the shift to technologies like Cloud, AI, and workflow automation. In the context of this change, business leaders recognize the pressing need for data-driven decision-making. As you strive to achieve higher levels of data integrity, data governance becomes imperative.

Data Governance 69

Data Governance Government Datasets Programming 69

Snowflake

NOVEMBER 11, 2024

What if you could streamline your efforts while still building an architecture that best fits your business and technology needs? Snowflake is committed to doing just that by continually adding features to help our customers simplify how they architect their data infrastructure.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

Precisely

JANUARY 27, 2025

In 2025, its more important than ever to make data-driven decisions, cut costs, and improve efficiency especially in the face of major challenges due to higher manufacturing costs, disruptive new technologies like artificial intelligence (AI), and tougher global competition. In fact, its second only to data quality.

Data Integration 59

Data Integration Data Governance Government Data Programming 59

Data Engineering Podcast

JUNE 30, 2024

How does the focus on data assets/data products shift your approach to observability as compared to a table/pipeline centric approach? With the focus on sharing ownership beyond the boundaries on the data team there is a strong correlation with data governance principles. When is Synq the wrong choice?

Pipeline-centric 147

Pipeline-centric Engineering Data Lake High Quality Data 147

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. However, they require a strong data foundation to be effective.

Data Analytics 59

Data Analytics Data Governance Government Data Integration 59

Precisely

FEBRUARY 12, 2024

This blog focuses on key technology considerations beyond location intelligence that help make location data actionable and help telcos achieve their growth and corporate sustainability goals. 5G technology planning and rollout : Telcos focus much of their attention on building out their 5G networks.

Data Governance 64

Data Governance Government Telecommunication Machine Learning 64

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Closing Announcements Thank you for listening!

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Snowflake

JUNE 27, 2024

By bringing workloads closer to the data, Snowflake Native Apps integrated with Snowpark Container Services makes it easier for RAI’s customers to adopt its technology. We’ve seen with Snowflake Native Apps and Snowpark Container Services, that can now happen in days and even hours, which is mind-blowing.”

Data Governance 124

Data Governance Algorithm Government Cloud 124

Precisely

JANUARY 23, 2024

Enterprise Challenges in 2024 and Beyond The big-picture process of building data that is accurate, consistent and contextual – or data integrity – calls for a systematic approach combining technology tools, internal change management, and a company-wide commitment to results.

Technology 69

Technology Data Governance Government Programming 69

Data Engineering Podcast

JUNE 23, 2024

What are the benefits of layering on top of existing technologies rather than building a fully custom solution? What do you have planned for the future of data lake analytics? Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 162

Data Lake High Quality Data Hadoop Machine Learning 162

Data Engineering Podcast

JUNE 16, 2024

In this episode Kevin Liu shares some of the interesting features that they have built by combining those technologies, as well as the challenges that they face in supporting the myriad workloads that are thrown at this layer of their data platform. What are the other systems that feed into and rely on the Trino/Iceberg service?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

Precisely

MARCH 28, 2025

However, they faced a growing challenge: integrating and accessing data across a complex environment. Some departments used IBM Db2, while others relied on VSAM files or IMS databases creating complex data governance processes and costly data pipeline maintenance.

Data Integration 69

Data Integration Pipeline-centric Database-centric Kafka 69

Data Engineering Podcast

APRIL 21, 2024

Summary Generative AI has rapidly transformed everything in the technology sector. Contact Info LinkedIn Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When Andrew Lee started work on Shortwave he was focused on making email more productive.

Data Lake 182

Data Lake High Quality Data Machine Learning Data Pipeline 182

Snowflake

SEPTEMBER 27, 2023

At Snowflake, we are dedicated to helping our customers effectively mobilize their data while upholding stringent standards for compliance and data governance. Today, we are thrilled to announce the general availability of the Data Governance Interface in Snowsight.

Data Governance 64

Data Governance Government SQL Database 64

RandomTrees

MARCH 10, 2025

Let’s explore predictive analytics, the ground-breaking technology that enables companies to anticipate patterns, optimize processes, and reach well-informed conclusions. Businesses may use this potent technology to make proactive decisions instead of reactive ones, which gives them a competitive edge in rapidly evolving industries.

Retail 52

Retail Hospitality Data Governance Banking 52

Ascend.io

DECEMBER 4, 2024

As we approach 2025, data teams find themselves at a pivotal juncture. The rapid evolution of technology and the increasing demand for data-driven insights have placed immense pressure on these teams. In this blog post, we’ll explore key strategies that data teams should adopt to prepare for the year ahead.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Precisely

AUGUST 29, 2024

Data observability continuously monitors data pipelines and alerts you to errors and anomalies. Data governance ensures AI models have access to all necessary information and that the data is used responsibly in compliance with privacy, security, and other relevant policies. used: who has access to it?

Data Governance 52

Data Governance Government High Quality Data Datasets 52

Data Engineering Weekly

MARCH 5, 2025

The modern data stack constantly evolves, with new technologies promising to solve age-old problems like scalability, cost, and data silos. Infrastructure Management: Setting up and maintaining an Iceberg-based data lakehouse requires expertise in infrastructure-as-code, monitoring, observability, and data governance.

Hadoop 57

Hadoop Metadata Data Ingestion Data Governance 57

Data Engineering Podcast

MAY 12, 2024

In Code Comments, host Jamie Parker, Red Hatter and experienced engineer, shares the journey of technologists from across the industry and their hard-won lessons in implementing new technologies. Code Comments Podcast Logo]([link] Putting new technology to use is an exciting prospect. Want to see Starburst in action?

Management 147

Management Data Lake High Quality Data Machine Learning 147

Data Engineering Podcast

APRIL 7, 2024

Summary Maintaining a single source of truth for your data is the biggest challenge in data engineering. Different roles and tasks in the business need their own ways to access and analyze the data in the organization. What do you have planned for the future of Cube? Closing Announcements Thank you for listening!

Data Lake 162

Data Lake High Quality Data BI Data Workflow 162

Data Engineering Podcast

JUNE 9, 2024

In Code Comments, host Jamie Parker, Red Hatter and experienced engineer, shares the journey of technologists from across the industry and their hard-won lessons in implementing new technologies. Code Comments Podcast Logo]([link] Putting new technology to use is an exciting prospect. Closing Announcements Thank you for listening!

Process 147

Process Data Lake High Quality Data Machine Learning 147

Snowflake

JUNE 5, 2024

At the same time, organizations must ensure the right people have access to the right content, while also protecting sensitive and/or Personally Identifiable Information (PII) and fulfilling a growing list of regulatory requirements. Additional built-in UI’s and privacy enhancements make it even easier to understand and manage sensitive data.

Government 116

Government Accessible Accessibility Cloud 116