Data Engineering Podcast

APRIL 22, 2018

Summary The information about how data is acquired and processed is often as important as the data itself. For this reason metadata management systems are built to track the journey of your business data to aid in analysis, presentation, and compliance. What is involved in deploying your metadata collection agents?

Business Intelligence 113

Business Intelligence Metadata Management Data Governance 113

Precisely

OCTOBER 31, 2024

Instead of relying on a central data management team, this architecture empowers your subject matter experts and domain owners to curate, maintain, and share data products that impact their domain. A data fabric weaves together different data management tools, metadata, and automation to create a seamless architecture.

Data Architecture 69

Data Architecture Architecture Metadata Government 69

Cloudera

MARCH 3, 2022

Whether the enterprise uses dozens or hundreds of data sources for multi-function analytics, all organizations can run into data governance issues. Bad data governance practices lead to data breaches, lawsuits, and regulatory fines — and no enterprise is immune. . Everyone Fails Data Governance.

Data Governance 100

Data Governance Government Metadata Medical 100

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. Focus on metadata management.

Data Analytics 72

Data Analytics Data Governance Data Integration Government 72

Precisely

SEPTEMBER 19, 2024

Key Takeaways: Data integrity is essential for AI success and reliability – helping you prevent harmful biases and inaccuracies in AI models. Robust data governance for AI ensures data privacy, compliance, and ethical AI use. Proactive data quality measures are critical, especially in AI applications.

Data Governance 78

Data Governance Government High Quality Data Datasets 78

Cloudera

MARCH 4, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. In a good data governance strategy, it is important to define roles that allow the business to limit the level of access that users can have to their strategic data assets.

Metadata 52

Metadata Data Governance Government Management 52

Cloudera

AUGUST 4, 2021

And if data security tops IT concerns, data governance should be their second priority. Not only is it critical to protect data, but data governance is also the foundation for data-driven businesses and maximizing value from data analytics. But it’s still not easy. But it’s still not easy.

Data Governance 86

Data Governance Government Metadata Data Security 86

Data Engineering Podcast

OCTOBER 15, 2021

Summary The binding element of all data work is the metadata graph that is generated by all of the workflows that produce the assets used by teams across the organization. The DataHub project was created as a way to bring order to the scale of LinkedIn’s data needs. How is the governance of DataHub being managed?

Metadata 100

Metadata BI Data Warehouse Government 100

phData: Data Engineering

NOVEMBER 1, 2024

In an effort to better understand where data governance is heading, we spoke with top executives from IT, healthcare, and finance to hear their thoughts on the biggest trends, key challenges, and what insights they would recommend. Get the Trendbook What is the Impact of Data Governance on GenAI?

Government 52

Government Data Governance Finance Metadata 52

Precisely

JANUARY 16, 2024

As the role of data and data-driven decision-making increases and as the overall volume and velocity of available data grows, data governance is evolving to meet a changing set of business requirements. What are the biggest trends in data governance for 2024? What’s the quality?”

Data Governance 69

Data Governance Government Metadata Data 69

Cloudera

MARCH 9, 2021

In this blog, we’ll highlight the key CDP aspects that provide data governance and lineage and show how they can be extended to incorporate metadata for non-CDP systems from across the enterprise. The SDX layer of CDP leverages the full spectrum of Atlas to automatically track and control all data assets.

Data Governance 97

Data Governance Government Metadata Datasets 97

Striim

MARCH 4, 2025

These incidents serve as a stark reminder that legacy data governance systems, built for a bygone era, are struggling to fend off modern cyber threats. They react too slowly, too rigidly, and cant keep pace with the dynamic, sophisticated attacks occurring today, leaving hackable data exposed.

Data Governance 40

Data Governance Government Healthcare NoSQL 40

Precisely

FEBRUARY 26, 2025

If pain points like these ring true for you, theres great news weve just announced significant enhancements to our Precisely Data Integrity Suite that directly target these challenges! Then, youll be ready to unlock new efficiencies and move forward with confident data-driven decision-making.

Data Integration 64

Data Integration Data Management Management Data Governance 64

Data Engineering Weekly

MARCH 5, 2025

This ecosystem includes: Catalogs: Services that manage metadata about Iceberg tables (e.g., Compute Engines: Tools that query and process data stored in Iceberg tables (e.g., Maintenance Processes: Operations that optimize Iceberg tables, such as compacting small files and managing metadata. Trino, Spark, Snowflake, DuckDB).

Hadoop 58

Hadoop Metadata Data Ingestion Data Governance 58

Cloudera

OCTOBER 23, 2024

In August, we wrote about how in a future where distributed data architectures are inevitable, unifying and managing operational and business metadata is critical to successfully maximizing the value of data, analytics, and AI.

Metadata 84

Metadata BI Data Lake Business Intelligence 84

Precisely

DECEMBER 8, 2023

As you strive to achieve higher levels of data integrity, data governance becomes imperative. What is Data Governance? Robert Seiner, author of Non-Invasive Data Governance and founder of KIK Consulting, defines data governance as “the execution and enforcement of authority over data.”

Data Governance 69

Data Governance Government Datasets Programming 69

Data Engineering Podcast

JUNE 16, 2024

what kinds of questions are you answering with table metadata what use case/team does that support comparative utility of iceberg REST catalog What are the shortcomings of Trino and Iceberg? What were the requirements and selection criteria that led to the selection of that combination of technologies? Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

François Nguyen

JANUARY 18, 2021

To finish the trilogy (Dataops, MLops), let’s talk about DataGovOps or how you can support your Data Governance initiative. In every step,we do not just read, transform and write data, we are also doing that with the metadata. Last part, it was added the data security and privacy part.

Data Governance 130

Data Governance Metadata Government Data Pipeline 130

Data Engineering Weekly

NOVEMBER 24, 2024

Canva writes about its custom solution using dbt and metadata capturing to attribute costs, monitor performance, and enable data-driven decision-making, significantly enhancing its Snowflake environment management. link] Grab: Metasense V2 - Enhancing, improving, and productionisation of LLM-powered data governance.

Data Engineering 58

Data Engineering Data Engineer Engineering Insurance 58

François Nguyen

MARCH 22, 2021

TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. How do we build data products ? How can we interoperate between the data domains ? Data As Code is a very strong choice : we do not want any UI because it is an heritage of the ETL period.

Technology 130

Technology Architecture Google Cloud Metadata 130

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. Focus on metadata management.

Data Analytics 59

Data Analytics Data Governance Government Data Integration 59

Ascend.io

JULY 11, 2024

Metadata is the information that provides context and meaning to data, ensuring it’s easily discoverable, organized, and actionable. It enhances data quality, governance, and automation, transforming raw data into valuable insights. This is what managing data without metadata feels like.

Metadata 52

Metadata IT Government High Quality Data 52

Precisely

JANUARY 11, 2023

As the role of data and data-driven decision-making increases and as the overall volume and velocity of available data grows, data governance is evolving to meet a changing set of business requirements. What are the biggest trends in data governance for 2023?

Data Governance 52

Data Governance Government Metadata Data 52

Knowledge Hut

APRIL 20, 2023

Data governance refers to the set of policies, procedures, mix of people and standards that organisations put in place to manage their data assets. It involves establishing a framework for data management that ensures data quality, privacy, security, and compliance with regulatory requirements.

Data Governance 59

Data Governance Government Data Cleanse Data Security 59

Cloudyard

OCTOBER 15, 2024

When using Iceberg tables, every Data Definition Language ( DDL ) operation triggers the generation of a new metadata JSON file that captures the updated structure. This article outlines a process for efficiently tracking schema changes in Iceberg tables by leveraging Snowflake’s powerful metadata storage capabilities.

Metadata 52

Metadata Data Governance Government Data Integration 52

RandomTrees

SEPTEMBER 17, 2024

The Unity Catalog is Databricks governance solution which integrates with Databricks workspaces and provides a centralized platform for managing metadata, data access, and security. Improved Data Discovery The tagging and documentation features in Unity Catalog facilitate better data discovery.

Data Governance 52

Data Governance Government Metadata Machine Learning 52

Ascend.io

DECEMBER 4, 2024

Assign cross-functional teams to manage these data products end-to-end to maintain quality, accessibility, and reliability. Standardize Data Governance Across Teams: Standardization is key to successfully implementing either framework. Implement CI/CD practices to ensure continuous delivery of data products.

Data Pipeline 52

Data Pipeline Metadata Data Workflow Data 52

Snowflake

NOVEMBER 2, 2023

Increased interoperability with other Apache Iceberg-compatible catalogs and engines Snowflake Horizon allows organizations to connect their data ecosystem inside and outside Snowflake through integrations with other Apache Iceberg-compatible catalogs and engines , and with leading data catalog and data governance partners.

Metadata 131

Metadata Government AWS Medical 131

Snowflake

NOVEMBER 11, 2024

Implement better data governance by easily tracking and handling sensitive data The Lineage Visualization Interface (public preview) allows customers to easily track the flow of data and ML assets with an interactive interface in Snowsight.

Data Architecture 105

Data Architecture Architecture Data Lake Kafka 105

Precisely

SEPTEMBER 15, 2023

Data governance is no trivial undertaking. When executed correctly, data governance transitions businesses from guesswork to data-informed strategies. For those who follow the right roadmap on their data governance journey, the payoff can be enormous.

Data Governance 52

Data Governance Government Programming Data 52

The Modern Data Company

MARCH 7, 2023

Data governance can be a powerful agent in scaling the use and distribution of trusted data throughout the company. If you missed it, make sure to catch up on Part 1 – Data Timeliness. What Is Data Taxonomy? Data that is properly classified, catalogued, and tagged is usually well-governed data.

Data Governance 52

Data Governance Government Metadata Datasets 52

Precisely

SEPTEMBER 5, 2023

Master Data Management systems (MDM) play an important role in harmonizing data assets across large and midsize enterprises. However, to get optimal value from your organization’s data, you need to apply the discipline of data governance to your MDM. How can they contribute their expertise?

Data Governance 52

Data Governance Government Data Management Management 52

Precisely

JUNE 24, 2024

The Precisely team recently had the privilege of hosting a luncheon at the Gartner Data & Analytics Summit in London. It was an engaging gathering of industry leaders from various sectors, who exchanged valuable insights into crucial aspects of data governance, strategy, and innovation.

Food 94

Food Data Analytics Pharmaceutical Consulting 94

Wayne Yaddow

MARCH 28, 2025

Different schemas, naming standards, and data definitions are frequently used by disparate repository source systems, which can lead to datasets that are incompatible or conflicting. To guarantee uniformity among datasets and enable precise integration, consistent data models and terminology must be established.

Data Integration 52

Data Integration Data Governance Government Datasets 52

Precisely

JULY 19, 2023

Data governance is fast becoming a business imperative. Many top executives and line-of-business managers lack a clear understanding of the benefits of data governance. Data is a valuable organizational asset, yet if an organization isn’t capable of fully utilizing that asset, there can be a substantial opportunity cost.

Data Governance 52

Data Governance Government Building Data 52

RandomTrees

SEPTEMBER 23, 2024

In the first part of Data Governance with Unity Catalog , we explored the fundamentals of Unity Catalog, including its core features, advantages, and a comparison with other data catalog tools. Let’s further unlock the potential of Unity Catalog as we explore these essential aspects of data governance.

Data Governance 52

Data Governance Government Scala Data 52

Snowflake

JANUARY 23, 2024

Snowpark ML Operations: Model management The path to production from model development starts with model management, which is the ability to track versioned model artifacts and metadata in a scalable, governed manner. The Snowpark Model Registry API provides simple catalog and retrieval operations on models.

Machine Learning 138

Machine Learning Metadata Python Telecommunication 138