DataKitchen

NOVEMBER 5, 2024

The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams. It is a layered approach to managing and transforming data. It sounds great, but how do you prove the data is correct at each layer?

Architecture 78

Architecture Raw Data Pipeline-centric Data Ingestion 78

Cloudera

JULY 11, 2022

What used to be bespoke and complex enterprise data integration has evolved into a modern data architecture that orchestrates all the disparate data sources intelligently and securely, even in a self-service manner: a data fabric. Cloudera data fabric and analyst acclaim. Next steps.

Data Architecture 107

Data Architecture Architecture Data Government 107

Cloudera

MAY 28, 2024

It’s not enough for businesses to implement and maintain a data architecture. The unpredictability of market shifts and the evolving use of new technologies means businesses need more data they can trust than ever to stay agile and make the right decisions.

Data Architecture 88

Data Architecture Architecture Data Lake Data Warehouse 88

Striim

APRIL 22, 2025

But complexity stands in the way: incompatible platforms, brittle pipelines, fragmented architectures, and the growing pressure of data privacy and compliance risks make it challenging for teams to deliver trusted, real-time data to models and applications. Define the must-have characteristics of a data streaming architecture.

Architecture 52

Architecture Data Architecture Building Datasets 52

Cloudera

MARCH 28, 2024

But, even with the backdrop of an AI-dominated future, many organizations still find themselves struggling with everything from managing data volumes and complexity to security concerns to rapidly proliferating data silos and governance challenges.

Data Architecture 94

Data Architecture Architecture Data Lake Data 94

Cloudera

SEPTEMBER 6, 2022

Data has continued to grow both in scale and in importance through this period, and today telecommunications companies are increasingly seeing data architecture as an independent organizational challenge, not merely an item on an IT checklist. Why telco should consider modern data architecture. The challenges.

Telecommunication 84

Telecommunication Data Architecture Architecture Government 84

Cloudera

JUNE 29, 2023

To improve the way they model and manage risk, institutions must modernize their data management and data governance practices. Implementing a modern data architecture makes it possible for financial institutions to break down legacy data silos, simplifying data management, governance, and integration — and driving down costs.

Data Architecture 85

Data Architecture Architecture Management Banking 85

KDnuggets

FEBRUARY 10, 2022

Going forward, data professionals have found a new way to address the scalability of sources through data mesh.

Data Architecture 108

Data Architecture Architecture IT Data 108

KDnuggets

APRIL 5, 2023

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

Kafka 108

Kafka Architecture Data Architecture Building 108

phData: Data Engineering

NOVEMBER 8, 2024

The world we live in today presents larger datasets, more complex data, and diverse needs, all of which call for efficient, scalable data systems. Open Table Format (OTF) architecture now provides a solution for efficient data storage, management, and processing while ensuring compatibility across different platforms.

Architecture 52

Architecture Systems Data Lake Google Cloud 52

Confluent

OCTOBER 30, 2020

A fundamental challenge with today’s “data explosion” is finding the best answer to the question, “So where do I put my data?” while avoiding the longer-term problem of data warehouses, […].

Data Architecture 119

Data Architecture Architecture Kafka Building 119

KDnuggets

FEBRUARY 16, 2022

How to Learn Math for Machine Learning; Data Mesh & Its Distributed Data Architecture; 5 Ways to Apply AI to Small Data Sets; Top 5 Free Machine Learning Courses; Junior Data Scientist: The Next Level.

Machine Learning 108

Machine Learning Data Architecture Architecture IT 108

Cloudera

AUGUST 1, 2024

Companies are deploying GenAI using several architectures: exposing data to open-source models without training on it (60%), training open-source models on their data (57%), using open-source models trained on-premises or in private clouds (50%), and developing proprietary Large Language Models (LLMs) or Small Language Models (26%).

Data Architecture 82

Data Architecture Architecture Deep Learning Data Security 82

Towards Data Science

OCTOBER 3, 2024

Three important lessons I have learned on my journey as data engineer and architect Continue reading on Towards Data Science »

Data Architecture 75

Data Architecture Architecture Data Science Data 75

Cloudera

AUGUST 30, 2022

Modern data architectures. To eliminate or integrate these silos, the public sector needs to adopt robust data management solutions that support modern data architectures (MDAs). Towards Data Science ). Deploying modern data architectures. Forrester ).

Data Architecture 79

Data Architecture Architecture Data Lake NoSQL 79

Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. We’ve seen this from all of our customers and are emphasizing building and iterating on modern data architectures. Do we need more than one?

Data Architecture 92

Data Architecture Architecture Cloud Computing Cloud 92

databricks

APRIL 26, 2023

One of Lakehouse's outstanding achievements is the ability to combine workloads for modern use cases, such as traditional BI, machine learning & AI.

Data Architecture 119

Data Architecture Architecture BI Machine Learning 119

Data Engineering Podcast

SEPTEMBER 7, 2020

In this episode he explains how it is designed to allow for querying and combining data where it resides, the use cases that such an architecture unlocks, and the innovative ways that it is being employed at companies across the world.

Architecture 100

Architecture Data Architecture SQL Engineering 100

Cloudera

SEPTEMBER 29, 2022

They are being bombarded with literature about seemingly independent new trends like data mesh and data fabric while dealing with the reality of having to work with hybrid architectures. Each of these trends claim to be complete models for their data architectures to solve the “everything everywhere all at once” problem.

Architecture 74

Architecture Data Architecture Metadata Data Warehouse 74

databricks

MAY 1, 2024

Modern data stacks provide the necessary flexibility and efficiency for analytics and AI. Learn how the Databricks Data Intelligence Platform makes use of them.

Data Architecture 125

Data Architecture Architecture Data 125

Data Engineering Podcast

MAY 29, 2022

In this episode SVP of engineering Shireesh Thota describes the impact on your overall system architecture that Singlestore can have and the benefits of using a cloud-native database engine for your next application. What are the core sets of workloads that SingleStore is aimed at addressing?

Database 100

Database Architecture Data Architecture PostgreSQL 100

Cloudera

OCTOBER 7, 2021

In this blog, I will demonstrate the value of Cloudera DataFlow (CDF) , the edge-to-cloud streaming data platform available on the Cloudera Data Platform (CDP) , as a Data integration and Democratization fabric. Introduction to the Data Mesh Architecture and its Required Capabilities.

Architecture 124

Architecture Metadata Kafka Government 124

Confluent

OCTOBER 25, 2024

Proceed further by establishing your own headless data architecture—formalizing a data access layer at the center of your org, accessible by both analytics and operations.

Data Architecture 59

Data Architecture Architecture Data Accessible 59

Confluent

OCTOBER 17, 2024

A headless data architecture separates data storage, management, optimization, and access from services that write, process, and query it—creating a single point of access control.

Data Architecture 59

Data Architecture Architecture Data Storage Data 59

Cloudera

JULY 29, 2022

This does not mean ‘one of each’ – a public cloud data strategy and an on-prem data strategy. Rather, it means a holistic and comprehensive enterprise data strategy, spanning both, supported by a modern data architecture. . The telco industry has also increased its spend by 48% on similar initiatives. .

Data Architecture 89

Data Architecture Architecture Unstructured Data Government 89

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Precisely

JANUARY 9, 2025

The goal of this post is to understand how data integrity best practices have been embraced time and time again, no matter the technology underpinning. In the beginning, there was a data warehouse The data warehouse (DW) was an approach to data architecture and structured data management that really hit its stride in the early 1990s.

Data Integration 119

Data Integration Hadoop Data Warehouse Data Lake 119

Cloudera

JUNE 27, 2023

The way to achieve this balance is by moving to a modern data architecture (MDA) that makes it easier to manage, integrate, and govern large volumes of distributed data. When you deploy a platform that supports MDA you can consolidate other systems, like legacy data mediation and disparate data storage solutions.

Data Architecture 62

Data Architecture Architecture Government Data Governance 62

Snowflake

APRIL 2, 2025

Data storage has been evolving, from databases to data warehouses and expansive data lakes, with each architecture responding to different business and data needs. Traditional databases excelled at structured data and transactional workloads but struggled with performance at scale as data volumes grew.

Data Lake 97

Data Lake Cloud Storage Metadata Data Warehouse 97

Data Engineering Podcast

JULY 3, 2022

Summary The ecosystem for data tools has been going through rapid and constant evolution over the past several years. These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows. BigQuery, Redshift, Snowflake, Firebolt, etc.)

Architecture 100

Architecture Metadata MongoDB MySQL 100

The Modern Data Company

JULY 29, 2024

This dramatic increase in vendors hasn’t led to the expected data revolution. Rather, it has created needlessly complex data architectures that are inflexible, resist change, and stifle innovation. It’s a final, frustrating hurdle in the race to become truly data-driven.

Data Architecture 52

Data Architecture Architecture Building Pipeline-centric 52

Cloudera

DECEMBER 17, 2024

The introduction of these faster, more powerful networks has triggered an explosion of data, which needs to be processed in real time to meet customer demands. Traditional data architectures struggle to handle these workloads, and without a robust, scalable hybrid data platform, the risk of falling behind is real.

Building 62

Building Telecommunication Data Architecture Architecture 62

Towards Data Science

JANUARY 31, 2025

Follow me through the steps on how to evolve your architecture to align with your business needs Continue reading on Towards Data Science

Architecture 48

Architecture Data Architecture Data Science Data 48

Hevo

DECEMBER 15, 2024

Introduction to Data Architecture Data architecture shows how data is managed, from collection to transformation to distribution and consumption. It tells about how data flows through the data storage systems. Data architecture is an important piece of data management.

Data Architecture 40

Data Architecture Architecture Data Storage Data 40

Cloudera

JANUARY 7, 2025

Leveraging Clouderas hybrid architecture, the organization optimized operational efficiency for diverse workloads, providing secure and compliant operations across jurisdictions while improving response times for public health initiatives. This transition streamlined data analytics workflows to accommodate significant growth in data volumes.

Cloud 82

Cloud Government AWS Unstructured Data 82

Towards Data Science

FEBRUARY 20, 2023

Continue reading on Towards Data Science » How well does it answer your business needs? Dilemma of a choice.

Architecture 98

Architecture Data Science Data IT 98