Cloudera

APRIL 21, 2021

In this blog, we discuss our journey to CDP for this critical cluster. The most important step in a successful upgrade to CDP Private Cloud Base is understanding your environment. Despite these challenges, we knew we wanted to go to CDP Private Cloud. We can finally set user-level access! Our cluster was running CDH 5.16.2

Cloud 121

Cloud Professional Services Java Data Warehouse 121

Cloudera

AUGUST 16, 2021

We just announced Cloudera DataFlow for the Public Cloud (CDF-PC), the first cloud-native runtime for Apache NiFi data flows. In this blog post we’re revisiting the challenges that come with running Apache NiFi at scale before we take a closer look at the architecture and core features of CDF-PC.

Cloud 122

Cloud Unstructured Data Utilities Metadata 122

The Pragmatic Engineer

OCTOBER 18, 2024

WP Engine is the challenger for the most popular managed WordPress hosting service – generating likely around $400M/year in revenue ( as per Automattic ), versus Automattic’s circa $500M/year, as per Automattic’s CEO, in a now-edited blog post. Automattic raised $980M in venture funding and was valued at $7.5B

Government 335

Government Engineering Project AWS 335

Knowledge Hut

NOVEMBER 16, 2023

From nebulous beginnings, the cloud has grown into a platform that has gained universal acceptance and is transforming businesses across industries. Companies that have adopted cloud technology have seen significant payoffs, with cloud-based tools redefining their data storage, data sharing, marketing and project management capabilities.

Cloud Computing 98

Cloud Computing Cloud Cloud Storage AWS 98

Snowflake

NOVEMBER 26, 2024

Many of our customers — from Marriott to AT&T — start their journey with the Snowflake AI Data Cloud by migrating their data warehousing workloads to the platform. This blog post is the second in a three-part series on migrations. million in cost savings annually.

Data Warehouse 97

Data Warehouse Cloud PostgreSQL Hadoop 97

Cloudera

FEBRUARY 10, 2022

After the launch of Cloudera DataFlow for the Public Cloud (CDF-PC) on AWS a few months ago, we are thrilled to announce that CDF-PC is now generally available on Microsoft Azure, allowing NiFi users on Azure to run their data flows in a cloud-native runtime. . The need for a cloud-native Apache NiFi service on Microsoft Azure.

Cloud 116

Cloud Kafka AWS Data Ingestion 116

Cloudera

MARCH 11, 2022

With the launch of CDP Public Cloud 7.2.14, Cloudera Streams Messaging for Data Hub deployments has gotten some powerful new features! this component was not available in the Public Cloud Streams Messaging deployments and only part of our on-premise releases. The post New Features in Cloudera Streams Messaging for CDP Public Cloud 7.2.14

Cloud 107

Cloud Kafka Utilities Database 107

Picnic Engineering

FEBRUARY 6, 2024

From Cloud-native to Hybrid and back again: Picnic’s on-premises computing journey Many companies are working on their digital transformation, transitioning their traditional on-premises deployment to a cloud setup. Picnic’s infrastructure design focuses on a rapidly scalable cloud solution.

Cloud 97

Cloud Transportation Cloud Computing Systems 97

Towards Data Science

JANUARY 26, 2023

In such cases one must consider the manner in which the files will be pulled to the application while taking into account: bandwidth capacity, network latency, and the application’s file access pattern. This continues a series of posts on the topic of efficient ingestion of data from the cloud (e.g., here , here , and here ).

Cloud Storage 98

Cloud Storage Big Data Cloud AWS 98

Snowflake

OCTOBER 17, 2023

See how ctrl+s provides in-depth insights into supply chain sustainability, while protecting sensitive customer information—all through Snowflake’s powerful, scalable Data Cloud. The company has combined 20+ years of consulting experience with a vast repository of carbon data to provide detailed and easily accessible supply chain insights.

Cloud 98

Cloud Consulting Transportation Manufacturing 98

Knowledge Hut

JANUARY 12, 2024

What comes to your mind when you hear the term 'Cloud'? Well, in a technologically advanced world, Cloud refers to a place where you can store and manage data on a device. Personally, I find it fascinating how saying, "I can handle the Cloud," has become a ticket to professional opportunities. What is Cloud Computing?

Cloud Computing 98

Cloud Computing Cloud Computer Science Programming Language 98

Cloudera

FEBRUARY 17, 2022

CDP Private Cloud Base is an on-premises version of Cloudera Data Platform (CDP). Provides self-service access to integrated, multi-function analytics on centrally managed and secured business data. Provides a consistent experience on Public Cloud, Multi-Cloud, and Private Cloud deployments. Upgrade HDP 3.1.5

Cloud 101

Cloud Data Professional Services Metadata 101

Data Engineering Podcast

APRIL 21, 2024

It is an open-source, cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. Contact Info LinkedIn Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 182

Data Lake High Quality Data Data Pipeline Machine Learning 182

DoorDash Engineering

NOVEMBER 29, 2022

In this post, we will discuss how we established a secure, stable, and resilient private network connection between DoorDash microservices and our vendor’s on-premise data centers by leveraging the network facilities from our cloud provider, Amazon Web Services (AWS). The traffic inside VPC is forwarded to a Direct Connect Gateway (DXG).

Cloud 97

Cloud AWS Amazon Web Services Data 97

Scott Logic

OCTOBER 18, 2023

Introduction In my previous blog post I discussed how migrating to the Cloud could help your organisation reach its Net Zero goals. I discussed how shifting your workloads away from on-premises data centres can reduce emissions by allowing you to leverage the expertise of cloud providers and their greater efficiency of scale.

Cloud 87

Cloud AWS BI Accessible 87

Precisely

DECEMBER 14, 2023

As 2023 comes to an end we’re counting down the Top 5 Data Integrity blog posts of the year. #5. When it comes to mainframe modernization, that means having easy access to mainframe data in your cloud environment or an efficient way to migrate data to the cloud.

Data Integration 69

Data Integration AWS Machine Learning Data 69

Knowledge Hut

JANUARY 11, 2024

Are you planning to appear for the AWS Cloud Practitioner Certification in 2023? Cloud Computing is one of the biggest industries in Information Technology.  Cloud Computing is allowing businesses and clients to transact better and incorporate innovative ideas in an effective way and on a massive scale.

AWS 96

AWS Amazon Web Services Cloud Cloud Computing 96

Snowflake

NOVEMBER 2, 2023

From the start, the Snowflake platform has been delivered as a service, consisting of optimized storage, elastic multi-cluster compute, and cloud services. Data engineers and data scientists can take advantage of Snowflake’s fast engine with secure access to open source libraries for processing images, video, audio and more.

Data Lake 107

Data Lake Data Warehouse Cloud Unstructured Data 107

Cloudera

AUGUST 27, 2024

It’s nearing the end of the summer in North America, and one report has been a staple on my reading list for more than a decade: the Flexera State of the Cloud Report. Cloud spend remained on top for the second year in a row, with public cloud spend exceeding budgets by an average of 15%.

Cloud 83

Cloud Banking Business Intelligence Healthcare 83

Cloudera

JUNE 14, 2024

To reach that goal, more businesses are turning toward hybrid cloud infrastructure – with data on-premises, in the cloud, or both – as a means to tap into valuable data. With hybrid cloud infrastructure firmly cemented as the preferred approach to data infrastructure, governance needs to be at the top of every to-do list.

Data Governance 74

Data Governance Government Cloud Insurance 74

Snowflake

JUNE 5, 2024

At the same time, organizations must ensure the right people have access to the right content, while also protecting sensitive and/or Personally Identifiable Information (PII) and fulfilling a growing list of regulatory requirements. The Internal Marketplace Snowflake is also making it easier for you to manage listings.

Government 113

Government Accessible Accessibility Cloud 113

Rockset

JUNE 21, 2024

We developed our search and analytics database, taking full advantage of the cloud, to eliminate the complexity inherent in the data infrastructure needed for these apps. With this acquisition, what we’ve developed over the years will help make AI accessible to all in a safe and beneficial way.

Database 145

Database Cloud Accessible Accessibility 145

Cloudera

NOVEMBER 1, 2022

In the private sector, excluding highly regulated industries like financial services, the migration to the public cloud was the answer to most IT modernization woes, especially those around data, analytics, and storage. It’s here where the private cloud delivers.

Cloud 89

Cloud Government Cloud Computing Data Architecture 89

Snowflake

DECEMBER 11, 2023

As far as cookies go, at Snowflake we had the foresight to capture the full URL of the campaign source—it captures whether the lead came from Facebook, paid search, the blog or another source. Snowflake has made data accessibility a non-issue. This means we can parse the URL to get insights ourselves.

Building 102

Building Cloud Media Algorithm 102

Cloudera

MARCH 11, 2021

At Cloudera, we’re helping our customers implement data flows on-premises and in the public cloud using Apache NiFi , a core component of Cloudera DataFlow. In this blog post, I want to share the top three requirements for data flows in 2021 that we hear from our customers. Multi-cloud is becoming a reality for many of our customers.

Cloud 119

Cloud Data Data Warehouse Data Integration 119

Cloudera

OCTOBER 18, 2022

With global spend on the public cloud reaching $385 billion in 2021 , Cloudera was by no means alone in identifying that we, too, needed to be conscious of the ever-increasing costs of our public cloud infrastructure. The goal was to provide a unified single source of truth for all our cloud spending. Project CloudCost — design.

Cloud 89

Cloud IT Data Warehouse Professional Services 89

Snowflake

DECEMBER 20, 2023

Accessing the necessary resources from cloud providers demands careful planning and up to month-long wait times due to the high demand for GPUs. There is no need to self-procure instances or make reservations with their public cloud provider. What makes Snowpark Container Services unique? Ready to get started?

Scala 132

Scala Government Java Cloud 132

Data Engineering Podcast

FEBRUARY 25, 2024

It is an open-source, cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.

Database 162

Database Technology Data Lake High Quality Data 162

Cloudera

DECEMBER 16, 2022

We are pleased to announce that Cloudera has been named a Leader in the 2022 Gartner ® Magic Quadrant for Cloud Database Management Systems. Cloudera has been recognized in this cloud DBMS report since its inception in 2020. We do it today when data is even bigger, and hybrid — and clouds — are expensive. This is unique.

Database 92

Database Cloud Systems Management 92

Data Engineering Podcast

APRIL 14, 2024

It is an open-source, cloud-native orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. N-dimensional vectors, point clouds, etc.) Dagster offers a new approach to building and running data platforms and data pipelines.

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Snowflake

JUNE 3, 2024

Today, Snowflake is delighted to announce Polaris Catalog to provide enterprises and the Iceberg community with new levels of choice, flexibility and control over their data, with full enterprise security and Apache Iceberg interoperability with Amazon Web Services (AWS), Confluent , Dremio, Google Cloud, Microsoft Azure, Salesforce and more.

Amazon Web Services 137

Amazon Web Services Google Cloud Data Architect Government 137

Cloudera

JUNE 2, 2022

Over the last few years, we have had a front-row seat in our customers’ hybrid cloud journey as they expand their data estate across the edge, on-premise, and multiple cloud providers. Over the last two years, the Cloudera DataFlow team has been hard at work building Cloudera DataFlow for the Public Cloud (CDF-PC).

Systems 104

Systems Data Lake Google Cloud Cloud 104

Cloudera

NOVEMBER 7, 2023

Navigating this intricate maze of data can be challenging, and that’s why Apache Ozone has become a popular, cloud-native storage solution that spans any data use case with the performance needed for today’s data architectures. Since Ozone supports the S3 API, it can also be accessed using the s3a connector.

Systems 105

Systems Hadoop Unstructured Data Media 105

Cloudera

AUGUST 30, 2022

This blog lays out some steps to help you incrementally advance efforts to be a more data-driven, customer-centric organization. Cloudera refers to this as universal data distribution, as explored further in this blog post. Leverage cloud where it makes sense, not because it’s fashionable. Embrace incremental progress.

Cloud Storage 107

Cloud Storage Government Data Governance Retail 107

Cloudera

APRIL 22, 2022

This blog post was written by Dean Bubley , industry analyst, as a guest author for Cloudera. . Part of this emphasis extends to helping enterprises deal with their data and overall cloud connectivity as well as local networks. At the same time, operators are also becoming more data- and cloud-centric themselves.

Data Solutions 134

Data Solutions Amazon Web Services Data Storage Google Cloud 134

Christophe Blefari

MARCH 31, 2023

We are slowly approaching the 2-years anniversary of the blog and the newsletter. To be honest time flies and I’d have preferred to do more for the blog in the start of the year but my freelancing activities and my laziness took me so much. This newsletter is about money ( credits ) Dear readers, already 3 months done in 2023.

Bytes 130

Bytes Data Google Cloud Education 130

Cloudera

JULY 9, 2021

While certainly not a new concept, Government missions are wholly dependent on real time access/analysis of data (wherever it may be (legacy data centers or public cloud) to render insight to support operational decisions. Will it support role-based access? A long one that isn’t always easy or linear.

Government 114

Government Building Cloud Data Ingestion 114