InData Labs

OCTOBER 17, 2023

Big data is central to the efficient running of all modern organizations, but to be of use, raw data must be suitably organized. Запись The benefits of modern data architecture впервые появилась InData Labs.

Data Architecture 105

Data Architecture Architecture Raw Data Big Data 105

DataKitchen

NOVEMBER 5, 2024

The Race For Data Quality In A Medallion Architecture The Medallion architecture pattern is gaining traction among data teams. It is a layered approach to managing and transforming data. It sounds great, but how do you prove the data is correct at each layer?

Architecture 78

Architecture Raw Data Pipeline-centric Data Ingestion 78

Cloudera

JULY 11, 2022

What used to be bespoke and complex enterprise data integration has evolved into a modern data architecture that orchestrates all the disparate data sources intelligently and securely, even in a self-service manner: a data fabric. Cloudera data fabric and analyst acclaim. Next steps.

Data Architecture 107

Data Architecture Architecture Data Government 107

ProjectPro

JUNE 6, 2025

This blog walks you through what does Snowflake do , the various features it offers, the Snowflake architecture, and so much more. Table of Contents Snowflake Overview and Architecture What is Snowflake Data Warehouse? Its analytical skills enable companies to gain significant insights from their data and make better decisions.

Architecture 56

Architecture IT Data Warehouse Amazon Web Services 56

Cloudera

MARCH 28, 2024

But, even with the backdrop of an AI-dominated future, many organizations still find themselves struggling with everything from managing data volumes and complexity to security concerns to rapidly proliferating data silos and governance challenges.

Data Architecture 94

Data Architecture Architecture Data Lake Data 94

Cloudera

MAY 28, 2024

It’s not enough for businesses to implement and maintain a data architecture. The unpredictability of market shifts and the evolving use of new technologies means businesses need more data they can trust than ever to stay agile and make the right decisions.

Data Architecture 88

Data Architecture Architecture Data Lake Data Warehouse 88

Teradata

MAY 30, 2025

Register now Home Insights Artificial Intelligence Article Build a Data Mesh Architecture Using Teradata VantageCloud on AWS Explore how to build a data mesh architecture using Teradata VantageCloud Lake as the core data platform on AWS. The data mesh architecture Key components of the data mesh architecture 1.

AWS 52

AWS Architecture Building Amazon Web Services 52

Striim

APRIL 22, 2025

But complexity stands in the way: incompatible platforms, brittle pipelines, fragmented architectures, and the growing pressure of data privacy and compliance risks make it challenging for teams to deliver trusted, real-time data to models and applications. Define the must-have characteristics of a data streaming architecture.

Architecture 52

Architecture Data Architecture Building Machine Learning 52

Cloudera

JUNE 29, 2023

To improve the way they model and manage risk, institutions must modernize their data management and data governance practices. Implementing a modern data architecture makes it possible for financial institutions to break down legacy data silos, simplifying data management, governance, and integration — and driving down costs.

Data Architecture 85

Data Architecture Architecture Management Banking 85

KDnuggets

APRIL 5, 2023

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

Kafka 108

Kafka Architecture Data Architecture Building 108

Confluent

OCTOBER 30, 2020

A fundamental challenge with today’s “data explosion” is finding the best answer to the question, “So where do I put my data?” while avoiding the longer-term problem of data warehouses, […].

Data Architecture 119

Data Architecture Architecture Kafka Building 119

phData: Data Engineering

NOVEMBER 8, 2024

The world we live in today presents larger datasets, more complex data, and diverse needs, all of which call for efficient, scalable data systems. Open Table Format (OTF) architecture now provides a solution for efficient data storage, management, and processing while ensuring compatibility across different platforms.

Architecture 52

Architecture Systems Data Lake Google Cloud 52

Towards Data Science

OCTOBER 3, 2024

Three important lessons I have learned on my journey as data engineer and architect Continue reading on Towards Data Science »

Data Architecture 75

Data Architecture Architecture Data Science Data 75

KDnuggets

FEBRUARY 16, 2022

How to Learn Math for Machine Learning; Data Mesh & Its Distributed Data Architecture; 5 Ways to Apply AI to Small Data Sets; Top 5 Free Machine Learning Courses; Junior Data Scientist: The Next Level.

Machine Learning 107

Machine Learning Data Architecture Architecture IT 107

Cloudera

AUGUST 1, 2024

Companies are deploying GenAI using several architectures: exposing data to open-source models without training on it (60%), training open-source models on their data (57%), using open-source models trained on-premises or in private clouds (50%), and developing proprietary Large Language Models (LLMs) or Small Language Models (26%).

Data Architecture 82

Data Architecture Architecture Deep Learning Data Security 82

Cloudera

AUGUST 9, 2022

With all of the buzz around cloud computing, many companies have overlooked the importance of hybrid data. The truth is, the future of data architecture is all about hybrid. We’ve seen this from all of our customers and are emphasizing building and iterating on modern data architectures. Do we need more than one?

Data Architecture 92

Data Architecture Architecture Cloud Computing Cloud 92

Netflix Tech

JUNE 12, 2025

Introducing UDA UDA (Unified Data Architecture) is the foundation for connected data in Content Engineering. They are faithful interpretations of the members of data systems as graph data. These models encode both the information architecture of the systems and the schemas of the data containers within.

70

70

ProjectPro

JUNE 6, 2025

The result was Apache Iceberg, a modern table format built to handle the scale, performance, and flexibility demands of today’s cloud-native data architectures. Apache Iceberg Architecture 1. Data Layer What are the main use cases for Apache Iceberg? Let us explore that its architecture to answer that.

Architecture 40

Architecture Data Lake Metadata Cloud Storage 40

databricks

APRIL 26, 2023

One of Lakehouse's outstanding achievements is the ability to combine workloads for modern use cases, such as traditional BI, machine learning & AI.

Data Architecture 114

Data Architecture Architecture BI Machine Learning 114

Data Engineering Podcast

MAY 29, 2022

In this episode SVP of engineering Shireesh Thota describes the impact on your overall system architecture that Singlestore can have and the benefits of using a cloud-native database engine for your next application. What are the core sets of workloads that SingleStore is aimed at addressing?

Database 100

Database Architecture Data Architecture PostgreSQL 100

Cloudera

OCTOBER 7, 2021

In this blog, I will demonstrate the value of Cloudera DataFlow (CDF) , the edge-to-cloud streaming data platform available on the Cloudera Data Platform (CDP) , as a Data integration and Democratization fabric. Introduction to the Data Mesh Architecture and its Required Capabilities.

Architecture 124

Architecture Metadata Kafka Government 124

Cloudera

JULY 29, 2022

This does not mean ‘one of each’ – a public cloud data strategy and an on-prem data strategy. Rather, it means a holistic and comprehensive enterprise data strategy, spanning both, supported by a modern data architecture. . The telco industry has also increased its spend by 48% on similar initiatives. .

Data Architecture 89

Data Architecture Architecture Unstructured Data Government 89

Confluent

OCTOBER 25, 2024

Proceed further by establishing your own headless data architecture—formalizing a data access layer at the center of your org, accessible by both analytics and operations.

Data Architecture 59

Data Architecture Architecture Data Accessible 59

Confluent

OCTOBER 17, 2024

A headless data architecture separates data storage, management, optimization, and access from services that write, process, and query it—creating a single point of access control.

Data Architecture 59

Data Architecture Architecture Data Storage Data 59

Snowflake

NOVEMBER 12, 2024

As part of Snowflake Unistore , Hybrid Tables unify both transactional and analytical workloads on a single database to simplify architectures as well as governance and security. "We are using Hybrid Tables as the backbone for our Data Services use cases,” says Ken Ostner, SVP of Data at Roofstock.

Food 97

Food Metadata Education Data Architect 97

Precisely

JANUARY 9, 2025

The goal of this post is to understand how data integrity best practices have been embraced time and time again, no matter the technology underpinning. In the beginning, there was a data warehouse The data warehouse (DW) was an approach to data architecture and structured data management that really hit its stride in the early 1990s.

Data Integration 119

Data Integration Data Warehouse Hadoop Data Lake 119

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

Simon Späti

MAY 26, 2023

.” If you’ve journeyed with us from Part 1, where we dove into the importance and history of data modeling, or joined us in Part 2 to explore various approaches and techniques, I’m delighted you’ve stuck around. In this third part, we’ll delve into data architecture patterns and their influence on data modeling.

Architecture 130

Architecture Data Engineering Data Engineer Engineering 130

ProjectPro

JUNE 6, 2025

Data pipelines are a significant part of the big data domain, and every professional working or willing to work in this field must have extensive knowledge of them. As data is expanding exponentially, organizations struggle to harness digital information's power for different business use cases. What is a Big Data Pipeline?

Data Pipeline 40

Data Pipeline Architecture Kafka Data Lake 40

databricks

MAY 1, 2024

Modern data stacks provide the necessary flexibility and efficiency for analytics and AI. Learn how the Databricks Data Intelligence Platform makes use of them.

Data Architecture 121

Data Architecture Architecture Data 121

Data Engineering Podcast

JULY 3, 2022

Summary The ecosystem for data tools has been going through rapid and constant evolution over the past several years. These technological shifts have brought about corresponding changes in data and platform architectures for managing data and analytical workflows. BigQuery, Redshift, Snowflake, Firebolt, etc.)

Architecture 100

Architecture Metadata MongoDB MySQL 100

databricks

JUNE 11, 2025

Lakebase introduces a new architecture for Postgres, that includes separation of compute and storage for independent scaling and branching. Deeply integrated with the lakehouse, Lakebase simplifies operational data workflows. Lakebases share the same architecture. Postgres is the leading open source standard for databases.

Entertainment 81

Entertainment Data Lake Manufacturing Consulting 81

Snowflake

APRIL 2, 2025

Data storage has been evolving, from databases to data warehouses and expansive data lakes, with each architecture responding to different business and data needs. Traditional databases excelled at structured data and transactional workloads but struggled with performance at scale as data volumes grew.

Data Lake 97

Data Lake Cloud Storage Metadata Data Warehouse 97

Cloudera

DECEMBER 17, 2024

The introduction of these faster, more powerful networks has triggered an explosion of data, which needs to be processed in real time to meet customer demands. Traditional data architectures struggle to handle these workloads, and without a robust, scalable hybrid data platform, the risk of falling behind is real.

Building 62

Building Telecommunication Data Architecture Architecture 62

Towards Data Science

JANUARY 31, 2025

Follow me through the steps on how to evolve your architecture to align with your business needs Continue reading on Towards Data Science

Architecture 48

Architecture Data Architecture Data Data Science 48

Cloudera

JANUARY 7, 2025

Leveraging Clouderas hybrid architecture, the organization optimized operational efficiency for diverse workloads, providing secure and compliant operations across jurisdictions while improving response times for public health initiatives. This transition streamlined data analytics workflows to accommodate significant growth in data volumes.

Cloud 82

Cloud Government AWS Unstructured Data 82

Towards Data Science

FEBRUARY 20, 2023

Continue reading on Towards Data Science » How well does it answer your business needs? Dilemma of a choice.

Architecture 98

Architecture Data Science Data IT 98