databricks

AUGUST 13, 2024

Databricks SQL Serverless is now Generally Available on Google Cloud Platform (GCP)! SQL Serverless is available in 7 GCP regions and 40+ regions across AWS, Azure and GCP.

Google Cloud 131

Google Cloud SQL Cloud AWS 131

Cloudera

OCTOBER 12, 2020

We are thrilled to announce that Cloudera has acquired Eventador , a provider of cloud-native services for enterprise-grade stream processing. We recently delivered all three of these streaming capabilities as cloud services through Cloudera Data Platform (CDP) Data Hub on AWS and Azure.

Cloud 132

Cloud Process Scala Kafka 132

WeCloudData

APRIL 16, 2025

A private or enterprise cloud is the type of cloud computing in which all the resources are dedicated to a single tenant. Private cloud allows organizations a high level of cloud computing benefits such as scalability, flexibility, access control, and faster service delivery.

Cloud 52

Cloud Cloud Computing Accessibility Accessible 52

DoorDash Engineering

MARCH 7, 2023

As backend developers, we needed to stay unblocked while the infrastructure — in this case AWS resources — was being created. It was fair to assume that we would use other AWS services, particularly SQS and AWS Secrets Manager. Use LocalStack to enable locally running AWS resources. No long waits during startup.

AWS 119

AWS PostgreSQL Database SQL 119

Netflix Tech

APRIL 8, 2025

By Cheng Xie , Bryan Shultz , and Christine Xu In a previous blog post , we described how Netflix uses eBPF to capture TCP flow logs at scale for enhanced network insights. Netflixs cloud microservices operate across multiple AWS regions. For instance, a significant portion of flows goes through AWS ELBs. With 30 c7i.2xlarge

AWS 75

AWS Kafka Cloud Programming 75

databricks

JULY 28, 2023

For the final part of our Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS series, we'll cover an important.

AWS 98

AWS Cloud Engineering 98

databricks

JANUARY 26, 2023

This is part two of a three-part series in Best Practices and Guidance for Cloud Engineers to deploy Databricks on AWS. You can.

AWS 98

AWS Cloud Engineering 98

Cloudera

AUGUST 16, 2021

Are you ready to turbo-charge your data flows on the cloud for maximum speed and efficiency? Deploy, manage and monitor your standard NiFi flows running on-premises or on CDP Data Hub into cloud-native flows running on Kubernetes clusters on AWS. . NEW Cloudera DataFlow for the Public Cloud.

Cloud 112

Cloud AWS Kafka Utilities 112

Cloudera

OCTOBER 13, 2020

On September 24, 2019, Cloudera launched CDP Public Cloud (CDP-PC) as the first step in delivering the industry’s first Enterprise Data Cloud. Over the past year, we’ve not only added Azure as a supported cloud platform, but we have improved the orginal services while growing the CDP-PC family significantly: Improved Services.

Cloud 97

Cloud Data Warehouse Machine Learning AWS 97

WeCloudData

APRIL 18, 2025

Hybrid cloud computing is a type of cloud computing that combines the benefits of both private and public clouds. The hybrid cloud empowers businesses to optimize performance, enhance security, and drive innovation. This blog explores the current landscape of […] The post Hybrid Cloud appeared first on WeCloudData.

Cloud 52

Cloud Cloud Computing IT AWS 52

DoorDash Engineering

NOVEMBER 29, 2022

In this post, we will discuss how we established a secure, stable, and resilient private network connection between DoorDash microservices and our vendor’s on-premise data centers by leveraging the network facilities from our cloud provider, Amazon Web Services (AWS).

Cloud 97

Cloud AWS Amazon Web Services Data 97

ProjectPro

FEBRUARY 8, 2023

AWS Glue is here to put an end to all your worries! Read this blog to understand everything about AWS Glue that makes it one of the most popular data integration solutions in the industry. Well, AWS Glue is the answer to your problems! Table of Contents What is AWS Glue? How Does AWS Glue Work?

AWS 98

AWS Scala Metadata Data Lake 98

Cloudera

SEPTEMBER 28, 2020

Cloudera delivers an enterprise data cloud that enables companies to build end-to-end data pipelines for hybrid cloud, spanning edge devices to public or private cloud, with integrated security and governance underpinning it to protect customers data. Support Kafka connectivity to HDFS, AWS S3 and Kafka Streams.

Cloud 132

Cloud Kafka Professional Services Metadata 132

The Pragmatic Engineer

OCTOBER 18, 2024

WP Engine is the challenger for the most popular managed WordPress hosting service – generating likely around $400M/year in revenue ( as per Automattic ), versus Automattic’s circa $500M/year, as per Automattic’s CEO, in a now-edited blog post. Automattic raised $980M in venture funding and was valued at $7.5B

Engineering 356

Engineering Government Project AWS 356

Cloudera

MARCH 31, 2021

CDP Public Cloud is now available on Google Cloud. The addition of support for Google Cloud enables Cloudera to deliver on its promise to offer its enterprise data platform at a global scale. CDP Public Cloud is already available on Amazon Web Services and Microsoft Azure. Data Preparation (Apache Spark and Apache Hive)

Google Cloud 94

Google Cloud Cloud Amazon Web Services Cloud Storage 94

Cloudera

NOVEMBER 3, 2023

These awards recognize Cloudera’s EMEA partners who are dedicated to transforming the future of data by leveraging the most complete hybrid, multi-cloud data platform. As a technology partner in their Cloud Innovation Center in Rome, Italy, we work with Accenture to bring clients tested, cutting-edge, and tailored IT solutions.

AWS 100

AWS Technology Amazon Web Services Insurance 100

Edureka

APRIL 22, 2025

The alternative, however, provides more multi-cloud flexibility and strong performance on structured data. Snowflake is a cloud-native platform for data warehouses that prioritizes collaboration, scalability, and performance. It provides real multi-cloud flexibility in its operations on AWS , Azure, and Google Cloud.

BI 52

BI Pipeline-centric Data Lake Google Cloud 52

Cloudera

FEBRUARY 10, 2022

After the launch of Cloudera DataFlow for the Public Cloud (CDF-PC) on AWS a few months ago, we are thrilled to announce that CDF-PC is now generally available on Microsoft Azure, allowing NiFi users on Azure to run their data flows in a cloud-native runtime. . The need for a cloud-native Apache NiFi service on Microsoft Azure.

Cloud 116

Cloud Kafka AWS Data Ingestion 116

Knowledge Hut

NOVEMBER 16, 2023

From nebulous beginnings, the cloud has grown into a platform that has gained universal acceptance and is transforming businesses across industries. Companies that have adopted cloud technology have seen significant payoffs, with cloud-based tools redefining their data storage, data sharing, marketing and project management capabilities.

Cloud Computing 98

Cloud Computing Cloud Cloud Storage AWS 98

Cloudera

AUGUST 26, 2021

The object store is readily available alongside HDFS in CDP (Cloudera Data Platform) Private Cloud Base 7.1.3+. Learn more about the impacts of global data sharing in this blog, The Ethics of Data Exchange. Boto3 is the standard python client for the AWS SDK. Ozone Namespace Overview. awsAccessKey=s3-spark-user/HOST@REALM.COM.

Data Science 113

Data Science Cloud Hadoop Metadata 113

Workfall

MAY 16, 2023

In this blog, we shall look at how we can create a Dockerfile to create an image with this executable. In this blog, we will cover: Docker AWS EC2 Hands-on Conclusion Docker We are going to containerize our application using Docker to make it easier to deploy on different target platforms. Enter the application name.

AWS 81

AWS Cloud Computing Coding Cloud 81

Towards Data Science

JANUARY 26, 2023

In this post we consider the case in which our data application requires access to one or more large files that reside in cloud object storage. This continues a series of posts on the topic of efficient ingestion of data from the cloud (e.g., The three we will evaluate here are: Python boto3 API, AWS CLI, and S5cmd.

Cloud Storage 98

Cloud Storage Big Data Cloud AWS 98

Cloudera

JUNE 15, 2021

Hence, we were pleased to announce the public release of Ansible-based automation to deploy CDP Private Cloud Base. This blog will walk through how to deploy a Private Cloud Base cluster, with security, with a minimum of human interaction. aws or.azure directories). infra_type can be omitted, "aws", "azure" or "gcp".

Cloud 86

Cloud AWS Kafka Management 86

Cloudera

NOVEMBER 25, 2021

As data continues to grow at an exponential rate, our customers are increasingly looking to advance and scale operations through digital transformation and the cloud. Cloudera and AWS: Harnessing the Power of Data and Cloud . Key advantages to leveraging a hybrid approach include include: .

Amazon Web Services 90

Amazon Web Services Cloud AWS Machine Learning 90

Cloudera

SEPTEMBER 10, 2021

Shared Data Experience ( SDX ) on Cloudera Data Platform ( CDP ) enables centralized data access control and audit for workloads in the Enterprise Data Cloud. The public cloud (CDP-PC) editions default to using cloud storage (S3 for AWS, ADLS-gen2 for Azure). Customer 1 – Centralized data authorization management.

Cloud Storage 83

Cloud Storage Accessible Accessibility Cloud 83

Scott Logic

OCTOBER 18, 2023

Introduction In my previous blog post I discussed how migrating to the Cloud could help your organisation reach its Net Zero goals. I discussed how shifting your workloads away from on-premises data centres can reduce emissions by allowing you to leverage the expertise of cloud providers and their greater efficiency of scale.

Cloud 87

Cloud AWS BI Accessibility 87

Cloudera

JANUARY 15, 2021

Cloud data warehouses allow users to run analytic workloads with greater agility, better isolation and scale, and lower administrative overhead than ever before. DW1 is an anonymized cloud data warehouse running on AWS and DW2 is an anonymized data warehouse running on GCP. Impala use of KRPC (see dedicated blog post ).

Data Warehouse 96

Data Warehouse Cloud Consulting SQL 96

Precisely

DECEMBER 14, 2023

As 2023 comes to an end we’re counting down the Top 5 Data Integrity blog posts of the year. #5. Trusted Generative AI using Precisely and AWS Welcome to an era where machines are breaking free from their traditional analytical roles to unleash boundless creativity and innovation. Read more > #2.

Data Integration 67

Data Integration AWS Machine Learning Data 67

Cloudera

MARCH 22, 2021

Cloudera Data Platform (CDP) Public Cloud allows users to deploy analytic workloads into their cloud accounts. These workloads cover the entire data lifecycle and are managed from a central multi-cloud Cloudera Control Plane. CDP provides the flexibility to deploy these resources into public or private subnets.

Accessible 98

Accessible Accessibility Cloud Kafka 98

Edureka

APRIL 22, 2025

This blog will explore the significant advancements, challenges, and opportunities impacting data engineering in 2025, highlighting the increasing importance for companies to stay updated. In 2025, this blog will discuss the most important data engineering trends, problems, and opportunities that companies should be aware of.

Data Engineering 52

Data Engineering Data Engineer Engineering Consulting 52

Edureka

APRIL 22, 2025

In today’s cloud-native world, applications must be agile, scalable, and loosely coupled. Enter Amazon EventBridge, a fully managed serverless event bus service that makes it easier to build event-driven applications using data from your AWS services, custom applications, or SaaS providers. What is Amazon EventBridge?

AWS 40

AWS Architecture Media Cloud 40

databricks

FEBRUARY 2, 2023

Last November, we announced the availability of the Security Analysis Tool (SAT) for AWS on our blog. Today we are excited to announce.

Cloud 98

Cloud AWS 98

Sync Computing

JANUARY 27, 2025

Databricks clusters and AWS EC2 In todays landscape, big data, which is data too large to fit into a single node machine, is transformed and managed by clusters. Understanding EC2 cost structure When using Amazon EC2, understanding the cost structure is crucial to managing and optimizing your cloud expenses effectively.

AWS 52

AWS Data Lake Machine Learning Big Data 52

Cloudera

OCTOBER 23, 2024

With Snowflake’s engine, Cloudera customers get easy self-service access to their data for BI and interactive dashboards anywhere their data lives, including multiple public clouds and on-premises. Try Cloudera’s open data lakehouse on AWS for 5 days for free here , or try Snowflake for free for 30 days here.

Metadata 84

Metadata BI Data Lake Business Intelligence 84

Cloudera

SEPTEMBER 15, 2023

Next — working backwards — collaboration tooling such as dashboards and developer environments like those on Amazon Web Services (AWS), are also key components to consider. Building your data monetization strategy on Cloudera and AWS AWS provides several products and solutions to support this approach.

Telecommunication 80

Telecommunication AWS Retail Amazon Web Services 80

Netflix Tech

SEPTEMBER 24, 2021

Our previous tech blog Packaging award-winning shows with award-winning technology detailed our packaging technology deployed on the streaming side. As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content.

Cloud 97

Cloud Bytes Cloud Storage Media 97

Snowflake

DECEMBER 4, 2023

With this public preview, those external catalog options are either “GLUE”, where Snowflake can retrieve table metadata snapshots from AWS Glue Data Catalog, or “OBJECT_STORE”, where Snowflake retrieves metadata snapshots directly from the specified cloud storage location. With these three options, which one should you use?

Building 121

Building Metadata Cloud Storage AWS 121