Seattle Data Guy

APRIL 21, 2025

If you work in data, then youve likely used BigQuery and youve likely used it without really thinking about how it operates under the hood. On the surface BigQuery is Google Clouds fully-managed, serverless data warehouse. … Read more The post What Is BigQuery And How Do You Load Data Into It?

IT 130

IT Google Cloud Data Warehouse Data 130

Cloudera

SEPTEMBER 29, 2020

Performance is one of the key, if not the most important deciding criterion, in choosing a Cloud Data Warehouse service. In today’s fast changing world, enterprises have to make data driven decisions quickly and for that they rely heavily on their data warehouse service. . benchmark.

Data Warehouse 120

Data Warehouse Cloud Storage Metadata Cloud 120

Cloudera

JULY 16, 2021

Did you know Cloudera customers, such as SMG and Geisinger , offloaded their legacy DW environment to Cloudera Data Warehouse (CDW) to take advantage of CDW’s modern architecture and best-in-class performance? Today, we are pleased to announce the general availability of HPL/SQL integration in CDW public cloud.

Data Warehouse 120

Data Warehouse SQL PostgreSQL Database 120

phData: Data Engineering

FEBRUARY 21, 2025

In this post, we will be particularly interested in the impact that cloud computing left on the modern data warehouse. We will explore the different options for data warehousing and how you can leverage this information to make the right decisions for your organization. Understanding the Basics What is a Data Warehouse?

Cloud 52

Cloud Data Warehouse Amazon Web Services Data Ingestion 52

Analytics Vidhya

MARCH 24, 2023

Docker is still considered one of the top tools for creating containers by building Images between containerization platforms or cloud platforms.

Cloud 225

Cloud Building Data Warehouse IT 225

Christophe Blefari

MARCH 1, 2023

dbt Core is an open-source framework that helps you organise data warehouse SQL transformation. dbt Labs also develop dbt Cloud which is a cloud product that hosts and runs dbt Core projects. This switch has been lead by modern data stack vision. With the public clouds—e.g. Enter the ELT.

Data Warehouse 278

Data Warehouse SQL Metadata Raw Data 278

Analytics Vidhya

FEBRUARY 1, 2023

Introduction Nowadays, organizations are looking for multiple solutions to deal with big data and related challenges. If you’re preparing for the Snowflake interview, […] The post A Comprehensive Guide Of Snowflake Interview Questions appeared first on Analytics Vidhya.

Data Cleanse 223

Data Cleanse Data Warehouse Big Data Cloud 223

Data Engineering Podcast

MAY 1, 2022

Summary The predominant pattern for data integration in the cloud has become extract, load, and then transform or ELT. Datafold shows how a change in SQL code affects your data, both on a statistical level and down to individual rows and values before it gets merged to production. Start trusting your data with Monte Carlo today!

Data Warehouse 100

Data Warehouse Data Integration Cloud Google Cloud 100

Analytics Vidhya

FEBRUARY 8, 2023

Introduction Amazon Redshift is a fully managed, petabyte-scale data warehousing Amazon Web Services (AWS). It allows users to easily set up, operate, and scale a data warehouse in the cloud.

Amazon Web Services 227

Amazon Web Services AWS Data Warehouse Cloud 227

Data Engineering Podcast

FEBRUARY 18, 2024

Summary A data lakehouse is intended to combine the benefits of data lakes (cost effective, scalable storage and compute) and data warehouses (user friendly SQL interface). Multiple open source projects and vendors have been working together to make this vision a reality.

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Confluent

JULY 26, 2021

Twenty years ago, the data warehouses of choice were Oracle and Teradata. Since then, growth and innovation has shifted to the cloud, and a new generation of data systems have […].

Systems 116

Systems Cloud Designing Data Warehouse 116

Snowflake

APRIL 2, 2025

Data storage has been evolving, from databases to data warehouses and expansive data lakes, with each architecture responding to different business and data needs. Traditional databases excelled at structured data and transactional workloads but struggled with performance at scale as data volumes grew.

Data Lake 91

Data Lake Cloud Storage Metadata Data Warehouse 91

Hevo

SEPTEMBER 4, 2024

A data warehouse is a centralized system that stores, integrates, and analyzes large volumes of structured data from various sources. It is predicted that more than 200 zettabytes of data will be stored in the global cloud by 2025.

Data Warehouse 72

Data Warehouse Structured Data Data Cloud 72

Analytics Vidhya

FEBRUARY 25, 2023

The need for a data lake arises from the growing volume, variety, and velocity of data companies need to manage and analyze.

Cloud Storage 162

Cloud Storage Data Lake Cloud Unstructured Data 162

Data Engineering Podcast

MARCH 27, 2022

Summary Data governance is a practice that requires a high degree of flexibility and collaboration at the organizational and technical levels. The growing prominence of cloud and hybrid environments in data management adds additional stress to an already complex endeavor.

Data Governance 130

Data Governance Government Cloud Building 130

Cloudera

JANUARY 28, 2022

As I meet with our customers, there are always a range of discussions regarding the use of the cloud for financial services data and analytics. Customers vary widely on the topic of public cloud – what data sources, what use cases are right for public cloud deployments – beyond sandbox, experimentation efforts.

Cloud 115

Cloud Banking Data Governance Government 115

Data Engineering Podcast

MAY 29, 2022

Summary The latest generation of data warehouse platforms have brought unprecedented operational simplicity and effectively infinite scale. In order to ensure that you can explore and analyze your data without spending money on inefficient queries Mingsheng Hong and Zheng Shao created Bluesky Data.

Cloud 100

Cloud Data Warehouse Data Data Lake 100

Christophe Blefari

MARCH 15, 2024

Postgres creator launches DBOS, a transactional serverless computing platform — Mike sees DBOS like a cloud-native OS that runs on-top of the database in order to rethink application development and deployment. Arroyo, a stream-processing platform, rebuilt their engine using DataFusion.

Metadata 272

Metadata Data Datasets Data Warehouse 272

Snowflake

MARCH 12, 2025

Anomalos ML-first approach to automated data quality has proven to be the best-of-breed solution capable of seamlessly handling our enterprise's scale and complexity as we continue to grow on the Snowflake AI Data Cloud. While working together, they bonded over their shared passion for data.

Unstructured Data 82

Unstructured Data High Quality Data Banking Machine Learning 82

Cloudera

APRIL 3, 2023

In this blog, we will share with you in detail how Cloudera integrates core compute engines including Apache Hive and Apache Impala in Cloudera Data Warehouse with Iceberg. We will publish follow up blogs for other data services. It allows us to independently upgrade the Virtual Warehouses and Database Catalogs.

Data Warehouse 82

Data Warehouse Java Metadata Data 82

Cloudera

APRIL 21, 2021

The most important step in a successful upgrade to CDP Private Cloud Base is understanding your environment. Despite these challenges, we knew we wanted to go to CDP Private Cloud. The post Drinking our own champagne – Cloudera upgrades to CDP Private Cloud appeared first on Cloudera Blog. before the upgrade.

Cloud 121

Cloud Professional Services Java Data Warehouse 121

Confessions of a Data Guy

JANUARY 12, 2023

Anyone who’s been roaming around the forest of Data Engineering has probably run into many of the newish tools that have been growing rapidly around the concepts of Data Warehouses, Data Lakes, and Lake Houses … the merging of the old relational database functionality with TB and PB level cloud-based file storage systems.

Data Lake 162

Data Lake Relational Database Data Warehouse Data Engineering 162

Christophe Blefari

JUNE 21, 2024

Snowflake was founded in 2012 around its data warehouse product, which is still its core offering, and Databricks was founded in 2013 from academia with Spark co-creator researchers, becoming Apache Spark in 2014. Snowflake and Databricks have the same goal, both are selling a cloud on top of classic 1  cloud vendors.

Metadata 147

Metadata Data Warehouse BI MySQL 147

Towards Data Science

MARCH 23, 2023

The difference between tables and views and how to use them Continue reading on Towards Data Science »

Data Warehouse 98

Data Warehouse Data Science Data Cloud Computing 98

Cloudera

OCTOBER 18, 2022

With global spend on the public cloud reaching $385 billion in 2021 , Cloudera was by no means alone in identifying that we, too, needed to be conscious of the ever-increasing costs of our public cloud infrastructure. The goal was to provide a unified single source of truth for all our cloud spending. Project CloudCost — design.

Cloud 89

Cloud IT Data Warehouse Professional Services 89

Striim

NOVEMBER 19, 2024

It’s a collaborative service between Striim and Microsoft based on Fabric Open Mirroring that enables real-time data replication from on-premise SQL Server databases to Azure Fabric OneLake. Microsoft Azure Fabric is an end-to-end analytics and data platform designed for enterprises that require a unified solution.

SQL 52

SQL Database Data Warehouse Data Pipeline 52

Analytics Vidhya

MARCH 10, 2023

Introduction Snowflake is a cloud-based data warehousing platform that enables enterprises to manage vast and complicated information by providing scalable storage and processing capabilities. It is intended to be a fully managed, multi-cloud solution that does not need clients to handle hardware or software.

Cloud 247

Cloud Designing Management Process 247

Data Engineering Podcast

FEBRUARY 5, 2023

Sign up now for early access to Materialize and get started with the power of streaming data with the same simplicity and low implementation cost as batch cloud data warehouses. Go to [dataengineeringpodcast.com/materialize]([link] Support Data Engineering Podcast

Data Engineering 147

Data Engineering Data Engineer Engineering PostgreSQL 147

Cloudera

APRIL 1, 2024

We’re excited to share that Gartner has recognized Cloudera as a Visionary among all vendors evaluated in the 2023 Gartner® Magic Quadrant for Cloud Database Management Systems. Download the complimentary 2023 Gartner Magic Quadrant for Cloud Database Management Systems report.

Cloud 105

Cloud Unstructured Data Metadata Government 105

Edureka

APRIL 22, 2025

The alternative, however, provides more multi-cloud flexibility and strong performance on structured data. Snowflake is a cloud-native platform for data warehouses that prioritizes collaboration, scalability, and performance. Its multi-cluster shared data architecture is one of its primary features.

BI 52

BI Pipeline-centric Data Lake Google Cloud 52

Snowflake

OCTOBER 17, 2023

See how ctrl+s provides in-depth insights into supply chain sustainability, while protecting sensitive customer information—all through Snowflake’s powerful, scalable Data Cloud. But providing these insights requires a huge amount of data, along with a platform that makes it easy to ingest, access and understand that data.

Cloud 102

Cloud Consulting Transportation Manufacturing 102

Sync Computing

NOVEMBER 7, 2024

Data volume and velocity, governance, structure, and regulatory requirements have all evolved and continue to. Despite these limitations, data warehouses, introduced in the late 1980s based on ideas developed even earlier, remain in widespread use today for certain business intelligence and data analysis applications.

Data Lake 52

Data Lake Data Warehouse Business Intelligence Unstructured Data 52

Data Engineering Podcast

APRIL 9, 2023

Summary The customer data platform is a category of services that was developed early in the evolution of the current era of cloud services for data processing. Now that the data warehouse has taken center stage a new approach of composable customer data platforms is emerging.

Data Lake 147

Data Lake Data Warehouse Machine Learning Data 147

Striim

MARCH 21, 2025

With instant elasticity, high-performance, and secure data sharing across multiple clouds , Snowflake has become highly in-demand for its cloud-based data warehouse offering. As organizations adopt Snowflake for business-critical workloads, they also need to look for a modern data integration approach.

Data Warehouse 52

Data Warehouse MongoDB MySQL Hadoop 52

Cloudera

NOVEMBER 1, 2022

In the private sector, excluding highly regulated industries like financial services, the migration to the public cloud was the answer to most IT modernization woes, especially those around data, analytics, and storage. It’s here where the private cloud delivers.

Cloud 89

Cloud Government Cloud Computing Data Architecture 89

Monte Carlo

OCTOBER 31, 2024

In addition, AI data engineers should be familiar with programming languages such as Python , Java, Scala, and more for data pipeline, data lineage, and AI model development. Data Storage Solutions As we all know, data can be stored in a variety of ways.

Data Engineering 52

Data Engineering Data Engineer Engineering Unstructured Data 52

Towards Data Science

MARCH 6, 2023

On-premise and cloud working together to deliver a data product Photo by Toro Tseleng on Unsplash Developing a data pipeline is somewhat similar to playing with lego, you mentalize what needs to be achieved (the data requirements), choose the pieces (software, tools, platforms), and fit them together.

Google Cloud 98

Google Cloud Cloud Storage Data Pipeline Cloud 98