Christophe Blefari

MARCH 15, 2024

Assisted AI wars are around the corner — I'm only following the French news, but the government is proudly doubling its budget for "AI defense" From what I know, AI is mainly used as an information companion to find signals in the huge amount of data we generate, creating more efficient agents. This is Croissant.

Metadata 272

Metadata Datasets Data Data Warehouse 272

Data Engineering Podcast

NOVEMBER 10, 2021

Summary A significant source of friction and wasted effort in building and integrating data management systems is the fragmentation of metadata across various tools. After experiencing the impacts of fragmented metadata and previous attempts at building a solution Suresh Srinivas and Sriharsha Chintalapani created the OpenMetadata project.

Metadata 100

Metadata Data Warehouse Data Lake BI 100

Snowflake

JUNE 5, 2024

Snowflake Horizon empowers these organizations to govern and discover with a built-in, unified set of compliance, security, privacy, interoperability and access capabilities for data, apps and models in the AI Data Cloud — and even extending these to Iceberg tables.

Government 105

Government Accessibility Accessible Cloud 105

Cloudera

MARCH 3, 2022

Whether the enterprise uses dozens or hundreds of data sources for multi-function analytics, all organizations can run into data governance issues. Bad data governance practices lead to data breaches, lawsuits, and regulatory fines — and no enterprise is immune. . Everyone Fails Data Governance. In 2019, the U.K.’s

Data Governance 105

Data Governance Government Metadata Medical 105

Cloudera

MARCH 4, 2024

In this article, we will walk you through the process of implementing fine grained access control for the data governance framework within the Cloudera platform. In a good data governance strategy, it is important to define roles that allow the business to limit the level of access that users can have to their strategic data assets.

Metadata 52

Metadata Data Governance Government Management 52

Data Engineering Podcast

OCTOBER 15, 2021

Summary The binding element of all data work is the metadata graph that is generated by all of the workflows that produce the assets used by teams across the organization. What are some examples of automated actions that can be triggered from metadata changes? How is the governance of DataHub being managed?

Metadata 100

Metadata BI Data Warehouse Government 100

Cloudera

DECEMBER 20, 2021

But balancing a strong layer of security and governance with easy access to data for all users is no easy task. Another option — a more rewarding one — is to include centralized data management, security, and governance into data projects from the start. Winner of the Data Impact Awards 2021: Security & Governance Leadership.

Government 96

Government Data Security Banking Metadata 96

Cloudera

MARCH 9, 2021

Governance and the sustainable handling of data is a critical success factor in virtually all organizations. In this blog, we’ll highlight the key CDP aspects that provide data governance and lineage and show how they can be extended to incorporate metadata for non-CDP systems from across the enterprise.

Data Governance 101

Data Governance Government Metadata Datasets 101

Snowflake

JANUARY 25, 2023

Using column-level metadata to automate data pipelines I believe the best answer to these questions is that automation tools we use need to be column-aware. For the future, our automation tools must collect and manage metadata at the column level. And the metadata must include more than just the data type and size.

Metadata 85

Metadata Data Pipeline Government Data 85

Cloudera

AUGUST 4, 2021

And if data security tops IT concerns, data governance should be their second priority. Not only is it critical to protect data, but data governance is also the foundation for data-driven businesses and maximizing value from data analytics. Data governance has always required a combination of people, processes and technology to work.

Data Governance 92

Data Governance Government Metadata Data Security 92

Precisely

SEPTEMBER 19, 2024

Robust data governance for AI ensures data privacy, compliance, and ethical AI use. But achieving AI mastery comes with its own unique hurdles – the most significant being ensuring the quality and governance of the data that fuels your AI systems. And within those data strategies, data governance is non-negotiable.

Data Governance 78

Data Governance Government High Quality Data Datasets 78

Data Engineering Podcast

JUNE 16, 2024

what kinds of questions are you answering with table metadata what use case/team does that support comparative utility of iceberg REST catalog What are the shortcomings of Trino and Iceberg? What were the requirements and selection criteria that led to the selection of that combination of technologies? Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

phData: Data Engineering

NOVEMBER 1, 2024

In an effort to better understand where data governance is heading, we spoke with top executives from IT, healthcare, and finance to hear their thoughts on the biggest trends, key challenges, and what insights they would recommend. With that, let’s get into the governance trends for data leaders! Want to Save This Guide for Later?

Government 52

Government Data Governance Finance Metadata 52

Ascend.io

JULY 11, 2024

Metadata is the information that provides context and meaning to data, ensuring it’s easily discoverable, organized, and actionable. It enhances data quality, governance, and automation, transforming raw data into valuable insights. This is what managing data without metadata feels like. What is Metadata?

Metadata 52

Metadata IT Government High Quality Data 52

François Nguyen

MARCH 22, 2021

How do we govern all these data products and domains ? and he/she has different actions to execute (reading, calling a vision API, transform, create metadata, store them, etc…). TL;DR After setting up and organizing the teams, we are describing 4 topics to make data mesh a reality. How do we build data products ?

Technology 130

Technology Architecture Google Cloud Metadata 130

Snowflake

SEPTEMBER 24, 2024

With the breakneck speed of AI advancement, new innovations inevitably outpace global governments’ abilities to regulate its use. Rather than struggle with a reactive approach tackling new technology case by case, governments worldwide are developing AI governance frameworks that proactively seek ways to address these challenges.

Government 75

Government Algorithm Machine Learning Metadata 75

François Nguyen

JANUARY 18, 2021

To finish the trilogy (Dataops, MLops), let’s talk about DataGovOps or how you can support your Data Governance initiative. In every step,we do not just read, transform and write data, we are also doing that with the metadata. The origin of the term : Datakitchen We must give credit to Chris Bergh and his team DataKictchen.

Data Governance 130

Data Governance Metadata Government Data Pipeline 130

Precisely

DECEMBER 8, 2023

As you strive to achieve higher levels of data integrity, data governance becomes imperative. What is Data Governance? Robert Seiner, author of Non-Invasive Data Governance and founder of KIK Consulting, defines data governance as “the execution and enforcement of authority over data.”

Data Governance 69

Data Governance Government Datasets Programming 69

Snowflake

JANUARY 23, 2024

With Snowpark ML, data scientists and ML engineers can use familiar Python frameworks for preprocessing and feature engineering as well as training models that can be managed and executed entirely in Snowflake without any data movement, silos or governance trade-offs.

Machine Learning 123

Machine Learning Metadata Python Telecommunication 123

Cloudyard

OCTOBER 15, 2024

When using Iceberg tables, every Data Definition Language ( DDL ) operation triggers the generation of a new metadata JSON file that captures the updated structure. This article outlines a process for efficiently tracking schema changes in Iceberg tables by leveraging Snowflake’s powerful metadata storage capabilities.

Metadata 52

Metadata Data Governance Government Data Integration 52

Christophe Blefari

JUNE 21, 2024

Below a diagram describing what I think schematises data platforms: Data storage — you need to store data in an efficient manner, interoperable, from the fresh to the old one, with the metadata. Edge stuff — and then everything else that goes with it like privacy, observability, orchestration, scheduling, governance, etc.

Metadata 147

Metadata Data Warehouse BI MySQL 147

Snowflake

JULY 25, 2024

Cortex Search offers state-of-the-art semantic and lexical search over your text data in Snowflake behind an intuitive user interface, and it comes with the robust security and governance features that Snowflake is known for. Secure and governed : Benefit from the same security and governance features as the rest of your Snowflake data.

Unstructured Data 115

Unstructured Data Metadata Government SQL 115

Precisely

OCTOBER 31, 2024

While data products may have different definitions in different organizations, in general it is seen as data entity that contains data and metadata that has been curated for a specific business purpose. Organizations need governance maturity to ensure that domain teams can manage their data effectively.

Data Architecture 69

Data Architecture Architecture Metadata Government 69

RandomTrees

SEPTEMBER 17, 2024

Databricks addresses this challenge with Unity Catalog, a comprehensive governance solution designed to streamline and secure data management across Databricks workspaces. It acts as a sophisticated metastore that not only organizes metadata but also enforces security and governance policies across various data assets and AI models.

Data Governance 52

Data Governance Government Metadata Machine Learning 52

Snowflake

NOVEMBER 2, 2023

Snowflake’s single, cross-cloud governance model has always been a powerful differentiator, enabling customers to manage their increasingly complex data ecosystems with simplicity and ease. As a result, Snowflake is enhancing its governance capabilities that thousands of customers already rely on through Snowflake Horizon.

Metadata 109

Metadata Government AWS Medical 109

Data Engineering Podcast

FEBRUARY 19, 2023

[Acryl]([link] The modern data stack needs a reimagined metadata management platform. Acryl Data’s vision is to bring clarity to your data through its next generation multi-cloud metadata management platform. Acryl]([link] The modern data stack needs a reimagined metadata management platform.

IT 147

IT Data Lake Metadata Data Warehouse 147

ThoughtSpot

OCTOBER 9, 2023

How ThoughtSpot builds trust with data catalog connectors For many, the data catalog is still the primary home for metadata enrichment and governance. Our data catalog integrations allow you to tap into this metadata wealth and surface it in the context where it’s needed most—when conducting business analytics.

Metadata 105

Metadata Data Government Data Governance 105

Cloudera

APRIL 18, 2024

In those discussions, it was clear that everyone understood the need to treat data estates more cohesively as a whole—that means bringing more attention to security, data governance, and metadata management, the latter of which has become increasingly popular.

Metadata 115

Metadata Government Data Governance Data 115

Cloudera

APRIL 2, 2024

It’s been said that the Federal Government is one of, if not the largest, producer of data in the United States, and this data is at the heart of mission delivery for agencies across the civilian to DoD spectrum. FedRAMP requires that we meet strict security standards to protect government data.

Designing 107

Designing Process Government Metadata 107

Knowledge Hut

APRIL 20, 2023

Data governance refers to the set of policies, procedures, mix of people and standards that organisations put in place to manage their data assets. An important aspect of data governance is measuring and monitoring its effectiveness using data governance metrics. What is Data Governance?

Data Governance 59

Data Governance Government Data Cleanse Data Security 59

Monte Carlo

SEPTEMBER 10, 2024

Poor data warehouse governance practices that led to the improper handling of sensitive European driver data. Uber’s misstep serves as a stark reminder of what can go wrong when data warehouse governance is neglected and makes clear that understanding and implementing solid data warehouse governance is more crucial than ever.

Data Warehouse 52

Data Warehouse Government Data Governance Metadata 52

Snowflake

JUNE 11, 2024

Governed ML Traceability: ML Lineage, in private preview, offers visibility into the usage of objects and artifacts across development and operations. With these new features in Snowflake ML, developers can leverage centralized, governed MLOps for faster management of features and models.

Management 94

Management Government Metadata Python 94

Snowflake

JUNE 21, 2024

Snowflake is now making it even easier for customers to bring the platform’s usability, performance, governance and many workloads to more data with Iceberg tables (now generally available), unlocking full storage interoperability. Get better Iceberg ecosystem interoperability with Primary Key information added to Iceberg table metadata.

Data Lake 117

Data Lake BI Business Intelligence Metadata 117

Precisely

JUNE 24, 2024

It was an engaging gathering of industry leaders from various sectors, who exchanged valuable insights into crucial aspects of data governance, strategy, and innovation. The concept of federated data governance sparked vigorous discussion.

Food 94

Food Data Analytics Pharmaceutical Consulting 94

Snowflake

MAY 15, 2024

By continuously monitoring metrics, metadata, lineage, and logs from across your data infrastructure and using ML-based anomaly detection to detect issues, they help data teams know about and resolve issues quickly. Metaplane ensures that every company can trust the data that powers their business.

Cloud 114

Cloud Metadata Data Pipeline Government 114

Cloudera

MAY 2, 2022

As digital transformation accelerates, and digital commerce increasingly becomes the dominant form of all commerce, regulators and governments around the world are recognizing the increased need for consumer protections and data protection measures.

Cloud 109

Cloud Government Healthcare Metadata 109

Data Engineering Podcast

JULY 17, 2022

Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities. Atlan is the metadata hub for your data ecosystem. And don’t forget to thank them for their continued support of this show!

Data Management 130

Data Management Management Metadata MongoDB 130