Cloudera

MAY 2, 2022

There are many reasons to deploy a hybrid cloud architecture — not least cost, performance, reliability, security, and control of infrastructure. But increasingly at Cloudera, our clients are looking for a hybrid cloud architecture in order to manage compliance requirements.

Cloud 104

Cloud Government Healthcare Metadata 104

Cloudera

AUGUST 10, 2021

With the release of CDP Private Cloud (PvC) Base 7.1.7, We expand on this feature later in this blog. Atlas / Kafka integration provides metadata collection for Kafa producers/consumers so that consumers can manage, govern, and monitor Kafka metadata and metadata lineage in the Atlas UI. x, and 6.3.x,

Cloud 97

Cloud Kafka Metadata SQL 97

Cloudera

MARCH 31, 2021

CDP Public Cloud is now available on Google Cloud. The addition of support for Google Cloud enables Cloudera to deliver on its promise to offer its enterprise data platform at a global scale. CDP Public Cloud is already available on Amazon Web Services and Microsoft Azure.

Google Cloud 94

Google Cloud Cloud Amazon Web Services Cloud Storage 94

Cloudera

AUGUST 16, 2021

We just announced Cloudera DataFlow for the Public Cloud (CDF-PC), the first cloud-native runtime for Apache NiFi data flows. In this blog post we’re revisiting the challenges that come with running Apache NiFi at scale before we take a closer look at the architecture and core features of CDF-PC.

Cloud 122

Cloud Unstructured Data Utilities Metadata 122

Cloudera

JANUARY 26, 2024

This will allow a data office to implement access policies over metadata management assets like tags or classifications, business glossaries, and data catalog entities, laying the foundation for comprehensive data access control. First, a set of initial metadata objects are created by the data steward.

Metadata 73

Metadata Data Governance Government Management 73

Netflix Tech

SEPTEMBER 24, 2021

Our previous tech blog Packaging award-winning shows with award-winning technology detailed our packaging technology deployed on the streaming side. As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content.

Cloud 96

Cloud Bytes Cloud Storage Media 96

Cloudera

JULY 15, 2021

The release of Cloudera Data Platform (CDP) Private Cloud Base edition provides customers with a next generation hybrid cloud architecture. Private Cloud Base Overview. The storage layer for CDP Private Cloud, including object storage. Traditional data clusters for workloads not ready for cloud. Edge or Gateway.

Architecture 102

Architecture Cloud Kafka Hadoop 102

Snowflake

NOVEMBER 2, 2023

From the start, the Snowflake platform has been delivered as a service, consisting of optimized storage, elastic multi-cluster compute, and cloud services. To learn more about how Snowflake supports the architecture patterns described in this blog post, visit our pages for data warehouse , data lake , data lakehouse , and data mesh.

Data Lake 115

Data Lake Data Warehouse Cloud Unstructured Data 115

Data Engineering Weekly

MARCH 5, 2025

This blog post expands on that insightful conversation, offering a critical look at Iceberg's potential and the hurdles organizations face when adopting it. This ecosystem includes: Catalogs: Services that manage metadata about Iceberg tables (e.g., If not handled correctly, managing this metadata can become a bottleneck.

Hadoop 58

Hadoop Metadata Data Ingestion Data Governance 58

Cloudera

MAY 6, 2021

In this article, I will be focusing on the contribution that a multi-cloud strategy has towards these value drivers, and address a question that I regularly get from clients: Is there a quantifiable benefit to a multi-cloud deployment? Infrastructure Cost Optimization.

Cloud 92

Cloud Insurance Metadata Utilities 92

Christophe Blefari

JUNE 21, 2024

Snowflake and Databricks have the same goal, both are selling a cloud on top of classic 1  cloud vendors. Both companies have added Data and AI to their slogan, Snowflake used to be The Data Cloud and now they're The AI Data Cloud. Snowflake Summit Snowflake took the lead, setting the tone.

Metadata 147

Metadata Data Warehouse BI MySQL 147

Snowflake

DECEMBER 4, 2023

With this public preview, those external catalog options are either “GLUE”, where Snowflake can retrieve table metadata snapshots from AWS Glue Data Catalog, or “OBJECT_STORE”, where Snowflake retrieves metadata snapshots directly from the specified cloud storage location. With these three options, which one should you use?

Building 122

Building Metadata Cloud Storage AWS 122

Cloudera

APRIL 1, 2024

We’re excited to share that Gartner has recognized Cloudera as a Visionary among all vendors evaluated in the 2023 Gartner® Magic Quadrant for Cloud Database Management Systems. Download the complimentary 2023 Gartner Magic Quadrant for Cloud Database Management Systems report.

Cloud 105

Cloud Unstructured Data Metadata Government 105

Cloudera

JANUARY 15, 2021

Cloud data warehouses allow users to run analytic workloads with greater agility, better isolation and scale, and lower administrative overhead than ever before. DW1 is an anonymized cloud data warehouse running on AWS and DW2 is an anonymized data warehouse running on GCP. Impala use of KRPC (see dedicated blog post ).

Data Warehouse 96

Data Warehouse Cloud Consulting SQL 96

Cloudera

NOVEMBER 12, 2020

Cloud has given us hope, with public clouds at our disposal we now have virtually infinite resources, but they come at a different cost – using the cloud means we may be creating yet another series of silos, which also creates unmeasurable new risks in security and traceability of our data. A solution.

Cloud 104

Cloud Data Warehouse Banking Data 104

Confluent

AUGUST 27, 2019

We are excited to announce the release of Confluent Cloud Schema Registry in general availability (GA), available in Confluent Cloud , our fully managed event streaming service based on Apache Kafka ®. Before we dive into Confluent Cloud Schema Registry, let’s recap what Confluent Schema Registry is and does.

Cloud 18

Cloud Kafka Electronics Metadata 18

Cloudera

OCTOBER 25, 2021

With the launch of the Cloudera Public Cloud 7.2.12, the Streams Messaging for Data Hub deployments have gotten some interesting new features! In CDP Public Cloud 7.2.8, an Atlas hook was provided that once configured allows for Kafka metadata to be collected. The post New Features in Cloudera Streams Messaging Public Cloud 7.2.12

Cloud 91

Cloud Kafka Metadata Management 91

Cloudera

FEBRUARY 17, 2022

CDP Private Cloud Base is an on-premises version of Cloudera Data Platform (CDP). Provides a consistent experience on Public Cloud, Multi-Cloud, and Private Cloud deployments. One of our previous blogs discussed the four paths to get from legacy platforms to CDP Private Cloud Base. Upgrade HDP 3.1.5

Cloud 101

Cloud Data Professional Services Database 101

phData: Data Engineering

NOVEMBER 1, 2024

This blog is a collection of those insights, but for the full trendbook, we recommend downloading the PDF. Organizations also need a better understanding of how LLMs are trained, especially with external vendors or public cloud environments. Quotes Data governance is going to play a large role in what data can go into an LLM.

Government 52

Government Data Governance Finance Metadata 52

phData: Data Engineering

NOVEMBER 8, 2024

In this blog, we will discuss: What is the Open Table format (OTF)? Then, we add another column called HASHKEY , add more data, and locate the S3 file containing metadata for the iceberg table. In the screenshot below, we can see that the metadata file for the Iceberg table retains the snapshot history. Why should we use it?

Architecture 52

Architecture Systems Data Lake Google Cloud 52

Cloudera

MAY 17, 2021

Making a decision on a cloud data warehouse is a big deal. Modernizing your data warehousing experience with the cloud means moving from dedicated, on-premises hardware focused on traditional relational analytics on structured data to a modern platform.

Data Warehouse 90

Data Warehouse Cloud Government Metadata 90

Cloudera

SEPTEMBER 21, 2020

As organizations look to optimize the speed and cost of their cloud journey in today’s rapidly evolving economy, Cloudera is delighted to announce the availability of Cloudera Data Platform (CDP) Public Cloud in AWS Marketplace. It also includes AWS credits for free CDP trials and the mitigation of migration costs.

AWS 83

AWS Cloud Amazon Web Services Data Warehouse 83

Cloudera

DECEMBER 15, 2022

Today, we are thrilled to share some new advancements in Cloudera’s integration of Apache Iceberg in CDP to help accelerate your multi-cloud open data lakehouse implementation. Multi-cloud deployment with CDP public cloud. Multi-cloud capability is now available for Apache Iceberg in CDP. Advanced capabilitie.

Cloud 80

Cloud Metadata Data Warehouse Google Cloud 80

Cloudera

OCTOBER 11, 2021

Customers can now seamlessly automate migration to Cloudera’s Hybrid Data Platform — Cloudera Data Platform (CDP) to dynamically auto-scale cloud services with Cloudera Data Engineering (CDE) integration with Modak Nabu. Cloud Speed and Scale. Also, enterprises can tap into new technologies like Kubernetes. Integrated security model

Data Engineer 95

Data Engineer Data Engineering Cloud Engineering 95

Cloudera

OCTOBER 7, 2021

In this blog, I will demonstrate the value of Cloudera DataFlow (CDF) , the edge-to-cloud streaming data platform available on the Cloudera Data Platform (CDP) , as a Data integration and Democratization fabric. Data and Metadata: Data inputs and data outputs produced based on the application logic. Introduction.

Architecture 124

Architecture Metadata Kafka Government 124

Cloudera

DECEMBER 16, 2022

We are pleased to announce that Cloudera has been named a Leader in the 2022 Gartner ® Magic Quadrant for Cloud Database Management Systems. Cloudera has been recognized in this cloud DBMS report since its inception in 2020. We do it today when data is even bigger, and hybrid — and clouds — are expensive. This is unique.

Database 92

Database Cloud Systems Management 92

Cloudera

JANUARY 19, 2022

Gartner® recognized Cloudera in three recent reports – Magic Quadrant for Cloud Database Management Systems (DBMS), Critical Capabilities for Cloud Database Management Systems for Analytical Use Cases and Critical Capabilities for Cloud Database Management Systems for Operational Use Cases.

Database 90

Database Cloud Data Warehouse Data Lake 90

Cloudera

JUNE 25, 2021

Many Cloudera customers are making the transition from being completely on-prem to cloud by either backing up their data in the cloud, or running multi-functional analytics on CDP Public cloud in AWS or Azure. Configure the required ports to enable connectivity from CDH to CDP Public Cloud (see docs for details).

Cloud 73

Cloud Data Lake Cloud Storage Metadata 73

Snowflake

AUGUST 7, 2024

The Snowflake AI Data Cloud is an end-to-end platform that supports all types of data, compute, use cases and personas across an entire organization. Before Snowflake starts executing the query, we look at the metadata of the partitions to determine whether the contents of a given partition are likely to end up in the final result.

Metadata 109

Metadata Algorithm Process Utilities 109

Cloudera

OCTOBER 15, 2021

Apache Ozone is a distributed, scalable, and high performance object store, available with Cloudera Data Platform Private Cloud. CDP Private Cloud uses Ozone to separate storage from compute, which enables it to handle billions of objects on-premises, akin to Public Cloud deployments which benefit from the likes of S3.

Cloud 87

Cloud Hadoop Data Analytics Metadata 87

Cloudera

NOVEMBER 5, 2020

How do you optimize your enterprise-wide infrastructure (mostly cloud) and application expenditures? CDP includes Cloudera Shared Data eXperience (SDX), a centralized set of security, governance, and management capabilities that make it possible to use cloud resources without sacrificing data privacy or creating compliance risks.

Cloud 74

Cloud Data Lake Data Warehouse Metadata 74

Cloudera

JUNE 25, 2019

Cloudera Unveils Industry’s First Enterprise Data Cloud in Webinar. How do you take a mission-critical on-premises workload and rapidly burst it to the cloud? Can you instantly auto-scale resources as demand requires and just as easily pause your work so you don’t run up your cloud bill? First-of-its-kind enterprise data cloud.

Cloud 87

Cloud Entertainment Machine Learning Government 87

Tweag

MAY 16, 2023

The manifest of a web app, the configuration of an Apache virtual host, an Infrastructure-as-Code (IaC) cloud deployment (Terraform, Kubernetes, etc.). That’s a dangerous mistake: with the advent of IaC for the cloud, configuration has become an important aspect of modern software systems, and a critical point of failure.

MySQL 135

MySQL Metadata Coding Data Validation 135

Cloudera

AUGUST 24, 2020

In the last blog with Deloitte’s Marc Beierschoder, we talked about what the hybrid cloud is, why it can benefit a business and what the key blockers often are in implementation. When building your data foundation, how can you prioritize innovation within a hybrid cloud strategy? You can read it here. .

Cloud 81

Cloud Building Government Data 81

Cloudera

JULY 10, 2024

In the public cloud, these cost management issues are compounded by consumption rates, where compute is often overused due to a lack of visibility into optimization opportunities. You can tap into insights such as where to optimize for the biggest gains, what you can do to fix workloads that don’t run, and how you can save money in the cloud.

Metadata 99

Metadata Cloud Management IT 99

Cloudera

FEBRUARY 22, 2022

Today, we are announcing a private technical preview (TP) release of Iceberg for CDP Data Services in the public cloud, including Cloudera Data Warehousing ( CDW ) and Cloudera Data Engineering ( CDE ). . Apache Iceberg is a new open table format targeted for petabyte-scale analytic datasets. Key Design Goals . Multi-function analytics .

Metadata 110

Metadata Datasets BI SQL 110

Cloudera

SEPTEMBER 29, 2020

Performance is one of the key, if not the most important deciding criterion, in choosing a Cloud Data Warehouse service. In this blog post, we compare Cloudera Data Warehouse (CDW) on Cloudera Data Platform (CDP) using Apache Hive-LLAP to Microsoft HDInsight (also powered by Apache Hive-LLAP) on Azure using the TPC-DS 2.9

Data Warehouse 120

Data Warehouse Cloud Storage Metadata Cloud 120