This site uses cookies to improve your experience. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country, we will assume you are from the United States. Select your Cookie Settings or view our Privacy Policy and Terms of Use.
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Used for the proper function of the website
Used for monitoring website traffic and interactions
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Blog Cloud Google Cloud 
Uber Engineering
SEPTEMBER 29, 2021
a driver starting a trip) and system actions … The post Building Uber’s Fulfillment Platform for Planet-Scale using Google Cloud Spanner appeared first on Uber Engineering Blog. The platform handles billions of database transactions each day, ranging from user actions (e.g.,
145 
databricks
AUGUST 13, 2024
Databricks SQL Serverless is now Generally Available on Google Cloud Platform (GCP)! SQL Serverless is available in 7 GCP regions and 40+ regions across AWS, Azure and GCP.
131
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Towards Data Science
APRIL 30, 2024
To achieve these characteristics, Google Dataflow is backed by a dedicated processing model, Dataflow, resulting from many years of Google research and development. Before we move on To avoid more confusing Dataflow is the Google stream processing model. In the rest of this blog, we will see how Google enables this contribution.
92 
Cloudera
MARCH 31, 2021
CDP Public Cloud is now available on Google Cloud. The addition of support for Google Cloud enables Cloudera to deliver on its promise to offer its enterprise data platform at a global scale. CDP Public Cloud is already available on Amazon Web Services and Microsoft Azure.
94 
databricks
MARCH 21, 2023
We are thrilled to announce that Databricks Unity Catalog is now generally available on Google Cloud Platform (GCP). Unity Catalog provides a unified.
106 
databricks
AUGUST 13, 2023
Today we are announcing the general availability of Delta Live Tables (DLT) on Google Cloud. DLT pipelines empower data engineers to build reliable.
98 
Uber Engineering
OCTOBER 27, 2024
Our latest blog dives into enabling security for Uber’s modernized batch data lake on Google Cloud Storage! Ready to boost your Hadoop Data Lake security on GCP?
KDnuggets
SEPTEMBER 23, 2024
In this blog, I will dive into free courses with Google, from programming. If you’ve been keeping up, I have been creating a series of free courses that are actually free, for example, the AI & ML Edition. Type in ‘Free courses that are actually free’ in the search bar to look at the rest.
92 
databricks
JUNE 15, 2023
We are excited to announce the official launch of the Google Pub/Sub connector for the Databricks Lakehouse Platform. This new connector adds to.
119 
databricks
NOVEMBER 1, 2023
We are excited to announce the general availability (GA) of several key security features for Databricks on Google Cloud: Private connectivity with Private.
73 
RandomTrees
OCTOBER 1, 2024
Cross-Platform Messaging: Objective: Enable robust cross-platform messaging for hybrid cloud use cases, facilitating smooth interaction B/W multiple environments. The architecture is designed to facilitate seamless communication between on-premises systems and cloud services, ensuring high availability and scalability. bin.tar.gz
52 
ProjectPro
FEBRUARY 6, 2023
With over 10 million active subscriptions, 50 million active topics, and a trillion messages processed per day, Google Cloud Pub/Sub makes it easy to build and manage complex event-driven systems. Google Pub/Sub provides global distribution of messages making it possible to send and receive messages from across the globe.
52 
Knoldus
JANUARY 31, 2023
Reading Time: 6 minutes Migrating data on Google Cloud BigQuery may seem like a straightforward task, until you run into having to match old data to tables with different schemas and data types. There are many approaches you can take to moving data, perhaps using SQL commands to transform the data to be compatible with the new schema.
52 
RandomTrees
FEBRUARY 22, 2024
How to Migrate Your Business to the Cloud Moving to the google cloud workload is one of the most impressive things your business can utilize to build your adaptability, flexibility, and productivity. Migrating your business to the cloud implies a ton of planning and attention.
52 
Knowledge Hut
JUNE 30, 2023
Businesses need cloud technologies to host their web applications and run their operations. Google Cloud is one of the leading cloud computing platforms in the world. The best certification to pursue novices is Google Cloud Engineer - Associate. Why Choose a Google Cloud Career?
52 
Cloud Academy
MAY 2, 2018
A 2017 IDC White Paper “recommend[s] that organizations that want to get the most out of cloud should train a wide range of stakeholders on cloud fundamentals and provide deep training to key technical teams ” (emphasis ours). Both come together on Google Cloud Machine Learning Engine. In a word, culture.
52 
phData: Data Engineering
NOVEMBER 8, 2024
In this blog, we will discuss: What is the Open Table format (OTF)? Note : Cloud Data warehouses like Snowflake and Big Query already have a default time travel feature. Amazon S3, Azure Data Lake, or Google Cloud Storage). Why should we use it? A Brief History of OTF A comparative study between the major OTFs.
52 
Jesse Anderson
DECEMBER 25, 2024
Frances Perry is an engineering manager who spent many years as a heads-down coder creating various distributed systems used in Google and Google Cloud.
130 
Data Engineering Weekly
JUNE 24, 2024
The blog contains a summary of each talk and a link to the YouTube channel with all the talks. The blog details the classification model, training approach and historical data analysis. The author highlighted three hypothesis contributing cost in Google Cloud Dataflow pipeline. Physical resources are underutilized.
109 
Snowflake
JUNE 3, 2024
Today, Snowflake is delighted to announce Polaris Catalog to provide enterprises and the Iceberg community with new levels of choice, flexibility and control over their data, with full enterprise security and Apache Iceberg interoperability with Amazon Web Services (AWS), Confluent , Dremio, Google Cloud, Microsoft Azure, Salesforce and more.
Striim
NOVEMBER 11, 2024
A leading home improvement retailer recognized the need to modernize its data infrastructure in order to move data from legacy systems to the cloud and improve operational efficiency. This made it difficult for the company to support critical initiatives like supply chain optimization and migration to the cloud.
52 
Cloudera
APRIL 29, 2021
on all three major cloud platforms, and it also brings Flow Management on DataHub with Apache NiFi 1.13.2 We hope you’ll enjoy these new releases, and you can get NiFi clusters up and running in Amazon Web Services, Microsoft Azure, and Google Cloud in no time! and additional improvements, bug fixes, components, etc.
77 
Ascend.io
NOVEMBER 14, 2024
In this blog post, we’ll explore key strategies for future-proofing your data pipelines. Cloud-Native Solutions One effective strategy for achieving scalability is adopting cloud-native solutions. Cloud platforms offer flexible and scalable resources that can be adjusted based on demand.
Striim
OCTOBER 3, 2024
.” Peter Laflin , Chief Data Officer at Morrisons, outlined the supermarket chain’s strategic partnership with Striim, a global leader in real-time data integration and streaming, and Google Cloud.
40 
Data Engineering Podcast
FEBRUARY 11, 2018
In your blog post that explains the design decisions for how Timescale is implemented you call out the fact that the inserted data is largely append only which simplifies the index management. Is timescale compatible with systems such as Amazon RDS or Google Cloud SQL? What impact has the 10.0
100 
Knowledge Hut
JANUARY 11, 2024
Are you planning to appear for the AWS Cloud Practitioner Certification in 2023? Cloud Computing is one of the biggest industries in Information Technology. Cloud Computing is allowing businesses and clients to transact better and incorporate innovative ideas in an effective way and on a massive scale.
96 
Cloudera
FEBRUARY 7, 2019
Who knew that in that search, the company would become the first organization to globally run SAS Viya, a cloud-optimized software, with HDP on GCP to enable modern analytics use cases powered by SAS analytics tools. Reducing Analytic Time to Value by More Than 90 Percent.
67 
Cloudera
APRIL 22, 2022
This blog post was written by Dean Bubley , industry analyst, as a guest author for Cloudera. . Part of this emphasis extends to helping enterprises deal with their data and overall cloud connectivity as well as local networks. At the same time, operators are also becoming more data- and cloud-centric themselves.
134 
Cloudera
SEPTEMBER 30, 2022
. Today, we’re excited to announce that DataFlow Functions (DFF), a feature within Cloudera DataFlow for the Public Cloud, is now generally available for AWS, Microsoft Azure, and Google Cloud Platform. Fig2: DataFlow Functions runtime environments are available in AWS Lambda, Azure Functions, and Google Cloud Functions.
80 
Cloudera
NOVEMBER 16, 2021
With the general availability of Cloudera DataFlow for the Public Cloud (CDF-PC) , our customers can now self-serve deployments of Apache NiFi data flows on Kubernetes clusters in a cost effective way providing auto scaling, resource isolation and monitoring with KPI-based alerting. Functions as a Service. Event driven use cases.
110 
Christophe Blefari
JANUARY 20, 2023
Thank you for every recommendation you do about the blog or the Data News. Perfect your modeling techniques ( credits ) Fast News ⚡️ Why I moved my dbt workloads to GitHub and saved over $65,000 — With the dbt Cloud price increase I already shared companies started to look for innovative way to run dbt.
130 
Data Engineering Weekly
JUNE 10, 2024
I will write a separate blog on these announcements after the Databricks conference; in the meantime, I found the blog from Cube Research, a balanced article about Snowflake Summit. Databricks and Snowflake offer a data warehouse on top of cloud providers like AWS, Google Cloud, and Azure.
103 
RandomTrees
JULY 15, 2024
Datadog is a powerful monitoring and analytics platform for modern cloud environments. Overview of Datadog Datadog is a monitoring and analytical tool for Cloud-scale applications. Datadog easily connects with popular cloud service providers such as Amazon Web Services (AWS), Microsoft Azure, Google Cloud Platform (GCP), and more.
52 
Towards Data Science
JANUARY 30, 2025
For example, if you have a Cloud Composer deployment, you can easily retrieve a DAG parse report by executing the following command on GoogleCLI: gcloud composer environments run $ENVIRONMENT_NAME location $LOCATION dags report While retrieving parse metrics is straightforward, measuring the effectiveness of your code optimizations can be less so.
48 
Cloudera
DECEMBER 15, 2022
Today, we are thrilled to share some new advancements in Cloudera’s integration of Apache Iceberg in CDP to help accelerate your multi-cloud open data lakehouse implementation. Multi-cloud deployment with CDP public cloud. Multi-cloud capability is now available for Apache Iceberg in CDP. Advanced capabilitie.
80 
Christophe Blefari
MARCH 31, 2023
We are slowly approaching the 2-years anniversary of the blog and the newsletter. To be honest time flies and I’d have preferred to do more for the blog in the start of the year but my freelancing activities and my laziness took me so much. This newsletter is about money ( credits ) Dear readers, already 3 months done in 2023.
130 
Cloudera
JUNE 2, 2022
Over the last few years, we have had a front-row seat in our customers’ hybrid cloud journey as they expand their data estate across the edge, on-premise, and multiple cloud providers. Over the last two years, the Cloudera DataFlow team has been hard at work building Cloudera DataFlow for the Public Cloud (CDF-PC).
104 
Data Engineering Podcast
FEBRUARY 6, 2022
If you’re a data engineering podcast listener, you get credits worth $3000 on an annual subscription StreamSets DataOps Platform is the world’s first single platform for building smart data pipelines across hybrid and multi-cloud architectures. Amp up your productivity with an easy-to-navigate interface and 100s of pre-built connectors.
100 
Knowledge Hut
SEPTEMBER 21, 2023
Azure or Google Cloud—Which is better? This question is often asked as businesses continue to understand the cloud’s usefulness and services. Sometimes, considering the three leading players in the cloud market, businesses search for the right cloud among the three to adopt. So, let’s dive in! What Is Azure?
52 
Data Engineering Weekly
JUNE 2, 2024
[link] Uber: Modernizing Uber’s Batch Data Infrastructure with Google Cloud Platform Uber is one of the largest Hadoop installations, with exabytes of data. The blog highlights the critical factors for data products' success: standardization of producing data assets, uniform CI/ CD process, and standard testing methodologies.
103 
Striim
FEBRUARY 2, 2024
Introducing Striim Cloud for Application Integration: A fully managed, simple, and scalable SaaS service for application connectors. With this new application integration service, users can stream real-time CRM, ERP, Billing, and Payment data from their cloud applications to data warehouses in minutes with zero coding.
52 
Confluent
MAY 22, 2019
Most IoT-based applications (both B2C and B2B) are typically built in the cloud as microservices and have similar characteristics. Most microservices developed in the cloud prefer to have a distributed database native to the cloud that can linearly scale. Google Cloud SDK. Download the Confluent Platform.
98 
Cloudera
JUNE 9, 2022
In the first blog of the Universal Data Distribution blog series , we discussed the emerging need within enterprise organizations to take control of their data flows. In this second installment of the Universal Data Distribution blog series, we will discuss a few different data distribution use cases and deep dive into one of them. .
Striim
JANUARY 17, 2025
Key considerations for building this foundation include: Unified Data Layer : Integrate data from various sources (cloud, on-premises, IoT devices, social media) into a unified pipeline for seamless AI processing.
52
Expert insights. Personalized for you.
We have resent the email to
Are you sure you want to cancel your subscriptions?
Let's personalize your content