Data Engineering Podcast

JULY 17, 2022

In this episode Crux CTO Mark Etherington discusses the different costs involved in managing external data, how to think about the total return on investment for your data, and how the Crux platform is architected to reduce the toil involved in managing third party data.

Data Management 130

Data Management Management Metadata MongoDB 130

Data Engineering Podcast

OCTOBER 15, 2021

Summary The binding element of all data work is the metadata graph that is generated by all of the workflows that produce the assets used by teams across the organization. The DataHub project was created as a way to bring order to the scale of LinkedIn’s data needs. How is the governance of DataHub being managed?

Metadata 100

Metadata BI Data Warehouse Government 100

Cloudera

DECEMBER 20, 2021

But balancing a strong layer of security and governance with easy access to data for all users is no easy task. Another option — a more rewarding one — is to include centralized data management, security, and governance into data projects from the start.

Government 96

Government Data Security Banking Metadata 96

Cloudera

MARCH 4, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. In a good data governance strategy, it is important to define roles that allow the business to limit the level of access that users can have to their strategic data assets.

Metadata 52

Metadata Data Governance Government Management 52

Data Engineering Podcast

JUNE 16, 2024

In this episode Kevin Liu shares some of the interesting features that they have built by combining those technologies, as well as the challenges that they face in supporting the myriad workloads that are thrown at this layer of their data platform. Can you describe what role Trino and Iceberg play in Stripe's data architecture?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

Precisely

SEPTEMBER 19, 2024

Key Takeaways: Data integrity is essential for AI success and reliability – helping you prevent harmful biases and inaccuracies in AI models. Robust data governance for AI ensures data privacy, compliance, and ethical AI use. Proactive data quality measures are critical, especially in AI applications.

Data Governance 78

Data Governance Government High Quality Data Datasets 78

phData: Data Engineering

NOVEMBER 1, 2024

In an effort to better understand where data governance is heading, we spoke with top executives from IT, healthcare, and finance to hear their thoughts on the biggest trends, key challenges, and what insights they would recommend. With that, let’s get into the governance trends for data leaders! No problem!

Government 52

Government Data Governance Finance Metadata 52

Precisely

SEPTEMBER 5, 2023

As this realization grows, businesses are shifting their investments from hardware to technologies that optimize data assets. Master Data Management systems (MDM) play an important role in harmonizing data assets across large and midsize enterprises. How can they contribute their expertise?

Data Governance 52

Data Governance Government Data Management Management 52

Ascend.io

JULY 11, 2024

Metadata is the information that provides context and meaning to data, ensuring it’s easily discoverable, organized, and actionable. It enhances data quality, governance, and automation, transforming raw data into valuable insights. This is what managing data without metadata feels like.

Metadata 52

Metadata IT Government High Quality Data 52

Data Engineering Podcast

FEBRUARY 19, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Hey there podcast listener, are you tired of dealing with the headache that is the 'Modern Data Stack'? It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze.

IT 147

IT Data Lake Metadata Data Warehouse 147

Precisely

OCTOBER 31, 2024

Key Takeaways: Data mesh is a decentralized approach to data management, designed to shift creation and ownership of data products to domain-specific teams. Data fabric is a unified approach to data management, creating a consistent way to manage, access, and share data across distributed environments.

Data Architecture 69

Data Architecture Architecture Metadata Government 69

Cloudera

APRIL 2, 2024

It’s been said that the Federal Government is one of, if not the largest, producer of data in the United States, and this data is at the heart of mission delivery for agencies across the civilian to DoD spectrum. FedRAMP requires that we meet strict security standards to protect government data.

Designing 107

Designing Process Government Metadata 107

LinkedIn Engineering

JULY 19, 2023

Open source data lakehouse deployments are built on the foundations of compute engines (like Apache Spark, Trino, Apache Flink), distributed storage (HDFS, cloud blob stores), and metadata catalogs / table formats (like Apache Iceberg, Delta, Hudi, Apache Hive Metastore). Tables are governed as per agreed upon company standards.

Big Data 78

Big Data Data Management Management Metadata 78

Christophe Blefari

JUNE 21, 2024

Below a diagram describing what I think schematises data platforms: Data storage — you need to store data in an efficient manner, interoperable, from the fresh to the old one, with the metadata. In order to make all of this work data flows, going IN and OUT.

Metadata 147

Metadata Data Warehouse BI MySQL 147

Data Engineering Podcast

OCTOBER 23, 2022

In this episode Shane Gibson shares practical advice and insights from his years of experience as a consultant and engineer working in data about how to adopt agile principles in your data work so that you can move faster and provide more value to the business, while building systems that are maintainable and adaptable.

Project 130

Project Metadata MongoDB MySQL 130

Precisely

JUNE 24, 2024

The Precisely team recently had the privilege of hosting a luncheon at the Gartner Data & Analytics Summit in London. It was an engaging gathering of industry leaders from various sectors, who exchanged valuable insights into crucial aspects of data governance, strategy, and innovation.

Food 94

Food Data Analytics Pharmaceutical Consulting 94

Cloudera

APRIL 18, 2024

In those discussions, it was clear that everyone understood the need to treat data estates more cohesively as a whole—that means bringing more attention to security, data governance, and metadata management, the latter of which has become increasingly popular.

Metadata 115

Metadata Government Data Governance Data 115

Data Engineering Podcast

NOVEMBER 26, 2023

In this episode Tobias Macey shares his thoughts on the challenges that he is facing as he prepares to build the next set of architectural layers for his data platform to enable a larger audience to start accessing the data being managed by his team. Closing Announcements Thank you for listening!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Precisely

JULY 18, 2024

Key Takeaways Data Fabric is a modern data architecture that facilitates seamless data access, sharing, and management across an organization. Data management recommendations and data products emerge dynamically from the fabric through automation, activation, and AI/ML analysis of metadata.

Data Management 52

Data Management Management Metadata Database-centric 52

RandomTrees

SEPTEMBER 17, 2024

In the realm of big data and AI, managing and securing data assets efficiently is crucial. Databricks addresses this challenge with Unity Catalog, a comprehensive governance solution designed to streamline and secure data management across Databricks workspaces. What is Unity Catalog?

Data Governance 52

Data Governance Government Metadata Machine Learning 52

Cloudera

JUNE 7, 2022

Cloudera Data Platform (CDP) is designed to address the critical requirements for modern data architectures today and tomorrow. It is a unified platform with portable, interoperable data analytics for the full data lifecycle and distributed data management running on public clouds, on-premises and at the edge.

IT 118

IT Unstructured Data Data Architecture Government 118

Knowledge Hut

APRIL 20, 2023

Data governance refers to the set of policies, procedures, mix of people and standards that organisations put in place to manage their data assets. It involves establishing a framework for data management that ensures data quality, privacy, security, and compliance with regulatory requirements.

Data Governance 59

Data Governance Government Data Cleanse Data Security 59

Data Engineering Podcast

MAY 22, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

Monte Carlo

SEPTEMBER 10, 2024

This truth was hammered home recently when ride-hailing giant Uber found itself on the receiving end of a staggering €290 million ($324 million) fine from the Dutch Data Protection Authority. Poor data warehouse governance practices that led to the improper handling of sensitive European driver data. The reason?

Data Warehouse 52

Data Warehouse Government Data Governance Metadata 52

François Nguyen

MARCH 7, 2021

In this article, Juan Sequada gives maybe one of the best definition of Data Mesh ” It is paradigm shift towards a distributed architecture that attempts to find an ideal balance between centralization and decentralization of metadata and data management.”

Government 130

Government Data Governance Data Metadata 130

Data Engineering Podcast

JULY 31, 2022

Summary Data lineage is the roadmap for your data platform, providing visibility into all of the dependencies for any report, machine learning model, or data warehouse table that you are working with. Atlan is the metadata hub for your data ecosystem. Data lineage and metadata systems are a hot topic right now.

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

JUNE 5, 2022

In this episode Sean Falconer explains the idea of a data privacy vault and how this new architectural element can drastically reduce the potential for making a mistake with how you manage regulated or personally identifiable information. Atlan is the metadata hub for your data ecosystem.

Data Security 100

Data Security Metadata MongoDB MySQL 100

Data Engineering Podcast

JULY 10, 2022

They also discuss how they have established a guild system for training and supporting data professionals in the organization. Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

The Modern Data Company

MARCH 7, 2023

Data governance can be a powerful agent in scaling the use and distribution of trusted data throughout the company. If you missed it, make sure to catch up on Part 1 – Data Timeliness. What Is Data Taxonomy? Data that is properly classified, catalogued, and tagged is usually well-governed data.

Data Governance 52

Data Governance Government Metadata Datasets 52

Cloudera

DECEMBER 16, 2022

We’re proud to be recognized for the data management and data analytics innovations we have delivered in the new Cloudera Data Platform (CDP). For example, Gartner has provided very pointed guidance on the urgency and inevitability of hybrid and multi-cloud for data management.

Database 97

Database Cloud Systems Management 97

Knowledge Hut

MARCH 7, 2024

Two, it creates a commonality of data definitions, concepts, metadata and the like. The traditional data management and data warehouses, and the sequence of data transformation, extraction and migration- all arise a situation in which there are risks for data to become unsynchronized.

Big Data 98

Big Data Bytes Data Governance Raw Data 98

Snowflake

NOVEMBER 29, 2023

While the former can be solved by tokenization strategies provided by external vendors, the latter mandates the need for patient-level data enrichment to be performed with sufficient guardrails to protect patient privacy, with an emphasis on auditability and lineage tracking. The principles emphasize machine-actionability (i.e.,

Metadata 89

Metadata Healthcare Medical Data Storage 89

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. However, they require a strong data foundation to be effective.

Data Analytics 72

Data Analytics Data Governance Data Integration Government 72

Cloudera

AUGUST 30, 2022

Data is the fuel that drives government, enables transparency, and powers citizen services. For state and local agencies, data silos create compounding problems: Inaccessible or hard-to-access data creates barriers to data-driven decision making. Data quality issues deter trust and hinder accurate analytics.

Data Architecture 84

Data Architecture Architecture Data Lake NoSQL 84

RandomTrees

SEPTEMBER 23, 2024

In the first part of Data Governance with Unity Catalog , we explored the fundamentals of Unity Catalog, including its core features, advantages, and a comparison with other data catalog tools. Let’s further unlock the potential of Unity Catalog as we explore these essential aspects of data governance.

Data Governance 52

Data Governance Government Scala Data 52

AltexSoft

MARCH 2, 2023

As the amount of enterprise data continues to surge, businesses are increasingly recognizing the importance of data governance — the framework for managing an organization’s data assets for accuracy, consistency, security, and effective use. What is data governance? billion in 2020 to $5.28

Data Governance 52

Data Governance Government Programming Healthcare 52

Precisely

JULY 19, 2023

Data governance is fast becoming a business imperative. Many top executives and line-of-business managers lack a clear understanding of the benefits of data governance. Data governance plays a critical role in risk management and compliance as well. How can you within your organization?

Data Governance 52

Data Governance Government Building Data 52