Data Engineering Podcast

MARCH 27, 2022

Summary Data governance is a practice that requires a high degree of flexibility and collaboration at the organizational and technical levels. The growing prominence of cloud and hybrid environments in data management adds additional stress to an already complex endeavor. Closing Announcements Thank you for listening!

Data Governance 130

Data Governance Government Cloud Building 130

Precisely

JULY 18, 2024

Key Takeaways Data Fabric is a modern data architecture that facilitates seamless data access, sharing, and management across an organization. Data management recommendations and data products emerge dynamically from the fabric through automation, activation, and AI/ML analysis of metadata.

Data Management 52

Data Management Management Metadata Database-centric 52

RandomTrees

SEPTEMBER 23, 2024

In the first part of Data Governance with Unity Catalog , we explored the fundamentals of Unity Catalog, including its core features, advantages, and a comparison with other data catalog tools. Let’s further unlock the potential of Unity Catalog as we explore these essential aspects of data governance.

Data Governance 52

Data Governance Government Scala Data 52

Knowledge Hut

APRIL 20, 2023

Data governance refers to the set of policies, procedures, mix of people and standards that organisations put in place to manage their data assets. It involves establishing a framework for data management that ensures data quality, privacy, security, and compliance with regulatory requirements.

Data Governance 59

Data Governance Government Data Cleanse Data Security 59

Data Engineering Podcast

OCTOBER 15, 2021

Summary The binding element of all data work is the metadata graph that is generated by all of the workflows that produce the assets used by teams across the organization. The DataHub project was created as a way to bring order to the scale of LinkedIn’s data needs. How is the governance of DataHub being managed?

Metadata 100

Metadata BI Data Warehouse Government 100

Data Engineering Podcast

APRIL 22, 2018

Summary The information about how data is acquired and processed is often as important as the data itself. For this reason metadata management systems are built to track the journey of your business data to aid in analysis, presentation, and compliance. What is involved in deploying your metadata collection agents?

Business Intelligence 113

Business Intelligence Metadata Management Data Governance 113

The Modern Data Company

MARCH 7, 2023

Data governance can be a powerful agent in scaling the use and distribution of trusted data throughout the company. If you missed it, make sure to catch up on Part 1 – Data Timeliness. What Is Data Taxonomy? Data that is properly classified, catalogued, and tagged is usually well-governed data.

Data Governance 52

Data Governance Government Metadata Datasets 52

Data Engineering Podcast

JUNE 16, 2024

In this episode Kevin Liu shares some of the interesting features that they have built by combining those technologies, as well as the challenges that they face in supporting the myriad workloads that are thrown at this layer of their data platform. Can you describe what role Trino and Iceberg play in Stripe's data architecture?

Data Lake 147

Data Lake High Quality Data Metadata Machine Learning 147

Precisely

JULY 19, 2023

Data governance is fast becoming a business imperative. Many top executives and line-of-business managers lack a clear understanding of the benefits of data governance. Data governance plays a critical role in risk management and compliance as well. How can you within your organization?

Data Governance 52

Data Governance Government Building Data 52

Precisely

OCTOBER 31, 2024

Key Takeaways: Data mesh is a decentralized approach to data management, designed to shift creation and ownership of data products to domain-specific teams. Data fabric is a unified approach to data management, creating a consistent way to manage, access, and share data across distributed environments.

Data Architecture 69

Data Architecture Architecture Metadata Government 69

AltexSoft

MARCH 2, 2023

As the amount of enterprise data continues to surge, businesses are increasingly recognizing the importance of data governance — the framework for managing an organization’s data assets for accuracy, consistency, security, and effective use. What is data governance? billion in 2020 to $5.28

Data Governance 52

Data Governance Government Programming Healthcare 52

phData: Data Engineering

NOVEMBER 1, 2024

In an effort to better understand where data governance is heading, we spoke with top executives from IT, healthcare, and finance to hear their thoughts on the biggest trends, key challenges, and what insights they would recommend. Get the Trendbook What is the Impact of Data Governance on GenAI?

Government 52

Government Data Governance Finance Metadata 52

Cloudera

OCTOBER 23, 2024

In August, we wrote about how in a future where distributed data architectures are inevitable, unifying and managing operational and business metadata is critical to successfully maximizing the value of data, analytics, and AI.

Metadata 83

Metadata BI Data Lake Business Intelligence 83

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. However, they require a strong data foundation to be effective.

Data Analytics 72

Data Analytics Data Governance Data Integration Government 72

Precisely

JUNE 24, 2024

The Precisely team recently had the privilege of hosting a luncheon at the Gartner Data & Analytics Summit in London. It was an engaging gathering of industry leaders from various sectors, who exchanged valuable insights into crucial aspects of data governance, strategy, and innovation.

Food 94

Food Data Analytics Pharmaceutical Consulting 94

Precisely

AUGUST 22, 2024

Key Takeaways Data fabric and data mesh are modern data management architectures that allow organizations to more easily understand, create, and manage data for more timely, accurate, consistent, and contextual data analytics and operations. The choice between the two depends on your business needs.

Data Governance 69

Data Governance Government High Quality Data Metadata 69

Precisely

NOVEMBER 18, 2024

Key Takeaways: Data integrity is required for AI initiatives, better decision-making, and more – but data trust is on the decline. Data quality and data governance are the top data integrity challenges, and priorities. However, they require a strong data foundation to be effective.

Data Analytics 59

Data Analytics Data Governance Data Integration Government 59

Cloudera

OCTOBER 10, 2024

The open data lakehouse is quickly becoming the standard architecture for unified multifunction analytics on large volumes of data. It combines the flexibility and scalability of data lake storage with the data analytics, data governance, and data management functionality of the data warehouse.

IT 84

IT Data Lake Metadata Data Warehouse 84

Cloudera

APRIL 18, 2024

In those discussions, it was clear that everyone understood the need to treat data estates more cohesively as a whole—that means bringing more attention to security, data governance, and metadata management, the latter of which has become increasingly popular.

Metadata 110

Metadata Government Data Governance Data 110

Databand.ai

JULY 19, 2023

Data lineage tools are not a new concept. However, their importance has grown significantly in recent years due to the increasing complexity of data architectures and the growing need for data governance and compliance. In this article: Why Are Data Lineage Tools Important?

Pipeline-centric 52

Pipeline-centric Data Governance Metadata Government 52

Monte Carlo

SEPTEMBER 10, 2024

Let’s dive into what data warehouse governance entails, why it matters, and how companies can avoid becoming the next cautionary tale. Table of Contents What is Data Warehouse Governance? Data warehouse governance is the set of policies, procedures, and controls that allow for the effective management of data.

Data Warehouse 52

Data Warehouse Government Data Governance Metadata 52

Data Engineering Podcast

JUNE 5, 2022

In this episode Sean Falconer explains the idea of a data privacy vault and how this new architectural element can drastically reduce the potential for making a mistake with how you manage regulated or personally identifiable information. Atlan is the metadata hub for your data ecosystem.

Data Security 100

Data Security Metadata MongoDB Scala 100

Knowledge Hut

MARCH 7, 2024

Two, it creates a commonality of data definitions, concepts, metadata and the like. The traditional data management and data warehouses, and the sequence of data transformation, extraction and migration- all arise a situation in which there are risks for data to become unsynchronized.

Big Data 98

Big Data Bytes Data Governance Raw Data 98

Precisely

MAY 13, 2024

Integrated data catalog for metadata support As you build out your IT ecosystem, it’s important to leverage tools that have the capabilities to support forward-looking use cases. A notable capability that achieves this is the data catalog. If so, how do you combine that metadata with other data across the enterprise? #4.

Data Integration 52

Data Integration Metadata Amazon Web Services Data Governance 52

Data Engineering Podcast

NOVEMBER 26, 2023

In this episode Tobias Macey shares his thoughts on the challenges that he is facing as he prepares to build the next set of architectural layers for his data platform to enable a larger audience to start accessing the data being managed by his team. Closing Announcements Thank you for listening!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Data Engineering Podcast

JULY 10, 2022

They also discuss how they have established a guild system for training and supporting data professionals in the organization. Atlan is the metadata hub for your data ecosystem. Instead of locking your metadata into a new silo, unleash its transformative potential with Atlan’s active metadata capabilities.

Metadata 100

Metadata MongoDB MySQL Data Pipeline 100

Monte Carlo

JULY 22, 2024

While it shares similarities with software versioning, data versioning has unique characteristics specific to your data management needs. Maintaining metadata about each version. By implementing data versioning, you can create a systematic approach to managing the evolution of your data.

Metadata 52

Metadata Datasets ETL Tools Data 52

Monte Carlo

MAY 14, 2024

At its core, a table format is a sophisticated metadata layer that defines, organizes, and interprets multiple underlying data files. Table formats incorporate aspects like columns, rows, data types, and relationships, but can also include information about the structure of the data itself.

Data Lake 52

Data Lake Metadata Hadoop Data Governance 52

Snowflake

NOVEMBER 29, 2023

While the former can be solved by tokenization strategies provided by external vendors, the latter mandates the need for patient-level data enrichment to be performed with sufficient guardrails to protect patient privacy, with an emphasis on auditability and lineage tracking. The principles emphasize machine-actionability (i.e.,

Metadata 87

Metadata Healthcare Medical Data Storage 87

Databand.ai

AUGUST 30, 2023

This includes defining roles and responsibilities related to managing datasets and setting guidelines for metadata management. Data profiling: Regularly analyze dataset content to identify inconsistencies or errors. This may include tasks such as data profiling, data cleansing, and metadata management.

Building 52

Building Data Cleanse Data Governance Datasets 52

Monte Carlo

FEBRUARY 21, 2023

Enter data fabric: a data management architecture designed to serve the needs of the business, not just those of data engineers. A data fabric is an architecture and associated data products that provide consistent capabilities across a variety of endpoints spanning multiple cloud environments.

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Monte Carlo

FEBRUARY 21, 2023

Enter data fabric: a data management architecture designed to serve the needs of the business, not just those of data engineers. A data fabric is an architecture and associated data products that provide consistent capabilities across a variety of endpoints spanning multiple cloud environments.

Data Architecture 52

Data Architecture Architecture Metadata Unstructured Data 52

Precisely

MAY 23, 2024

Integrated data catalog for metadata support As you build out your IT ecosystem, it is important to leverage tools that have the capabilities to support forward-looking use cases. A notable capability that achieves this is the data catalog.

Data Integration 64

Data Integration Metadata Telecommunication Data Governance 64

Precisely

JUNE 6, 2023

Tendü Yogurtçu offered that organizations today are viewing data as a product, and they are working to streamline access to both data and metadata for faster insights that help business users deliver tangible value. Data observability also helps users identify the root cause of problem in the data.

Data Architecture 52

Data Architecture Architecture Metadata Data Lake 52

Data Science Blog: Data Engineering

MAY 20, 2024

Saving time allows them to focus on their core job function – getting the insight out of the data and helping businesses make better decisions. Enter AnalyticsCreator AnalyticsCreator, a powerful tool for data management, brings a new level of efficiency and reliability to the CI/CD process.

Data Pipeline 52

Data Pipeline BI Data Lake Data Warehouse 52

phData: Data Engineering

SEPTEMBER 19, 2023

With many data modeling methodologies and processes available, choosing the right approach can be daunting. This blog will guide you through the best data modeling methodologies and processes for your data lake, helping you make informed decisions and optimize your data management practices. What is a Data Lake?

Data Lake 52

Data Lake Process Metadata Data Warehouse 52

Databand.ai

AUGUST 30, 2023

Integrating these principles with data operation-specific requirements creates a more agile atmosphere that supports faster development cycles while maintaining high quality standards. Organizations need to establish data governance policies, processes, and procedures, as well as assign roles and responsibilities for data governance.

Data Governance 40

Data Governance Data Cleanse Government Data Science 40