Data Engineering Podcast

AUGUST 5, 2018

Summary One of the longest running and most popular open source database projects is PostgreSQL. For anyone who hasn’t used it, can you describe what PostgreSQL is? What are some of the common points of confusion for new users of PostGreSQL? How did you get involved in the Postgres project?

PostgreSQL 100

PostgreSQL MySQL Banking Database 100

Hevo

MAY 9, 2023

As a business grows, the demand to efficiently handle and process the exponentially growing data also rises. A popular open-source relational database used by several organizations across the world is PostgreSQL.

PostgreSQL 97

PostgreSQL Relational Database Database Data Integration 97

ProjectPro

JUNE 6, 2025

This transformation is where data warehousing tools come into play, acting as the refining process for your data. These tools are crucial in modern business intelligence and data-driven decision-making processes. Amazon Redshift Pros High query performance via columnar storage and parallel processing.

40

40

Rock the JVM

MAY 22, 2024

Docker for Redis and PostgreSQL We’ll be using Docker images for Redis and Postgres. Next, we’ll create the SQL commands to create the database and necessary tables for Postgres. Skunk for PostgreSQL Integration In this section, we’ll implement the protocols necessary for interacting with Postgres in our application using Skunk.

PostgreSQL 136

PostgreSQL Scala Database SQL 136

Cloudera

JULY 16, 2021

They wish to run these stored procedures that were written for legacy DWs in CDW with minimal or no rewrites to accelerate the offloading process. . Today, we are pleased to announce the general availability of HPL/SQL integration in CDW public cloud. Cloudera values customers’ feedback. But don’t just take our word for it.

Data Warehouse 120

Data Warehouse SQL PostgreSQL Database 120

Data Engineering Podcast

MARCH 2, 2020

The ksqlDB project was created to address this state of affairs by building a unified layer on top of the Kafka ecosystem for stream processing. Developers can work with the SQL constructs that they are familiar with while automatically getting the durability and reliability that Kafka offers. What dialect of SQL is supported?

Kafka 100

Kafka Process PostgreSQL MySQL 100

Cloudera

AUGUST 10, 2022

Cloudera has a strong track record of providing a comprehensive solution for stream processing. Cloudera Stream Processing (CSP), powered by Apache Flink and Apache Kafka, provides a complete stream management and stateful processing solution. Cloudera Stream Processing Community Edition. Flink and SQL Stream Builder.

Process 91

Process Kafka PostgreSQL MySQL 91

ProjectPro

JUNE 6, 2025

Traditional ETL processes have long been a bottleneck for businesses looking to turn raw data into actionable insights. Zero ETL integrations minimize this complexity by automating data mapping and reducing the need for manual intervention, making the entire process more streamlined and efficient. How Does Zero-ETL Work?

40

40

Workfall

MARCH 28, 2023

This blog will demonstrate to you how Hasura and PostgreSQL can help you accelerate app development and easily launch backends. In this blog, we will cover: GraphQL Hasura PostgreSQL Hands-on Conclusion GraphQL GraphQL is an API query language and runtime for answering queries with existing data. Why Hasura is Fast?

PostgreSQL 75

PostgreSQL Coding MySQL Database 75

Data Engineering Podcast

JANUARY 13, 2020

In this episode Karthik Ranganathan explains how Yugabyte is architected, their motivations for being fully open source, and how they simplify the process of scaling your application from greenfield to global. In terms of the query API you have support for a Postgres compatible SQL dialect as well as a Cassandra based syntax.

SQL 100

SQL MongoDB PostgreSQL Database 100

Hevo

SEPTEMBER 22, 2023

Google Cloud SQL for PostgreSQL, a part of Google’s robust cloud ecosystem, offers businesses a dependable solution for managing relational data. However, with the expanding need for advanced data analytics, it is required to integrate data storage and processing platforms like Snowflake.

Google Cloud 52

Google Cloud PostgreSQL SQL Cloud 52

Hevo

AUGUST 18, 2023

There are several reasons why data replication from PostgreSQL on Amazon RDS to SQL Server may become necessary. These reasons include changes in business processes, increased data volumes, and enhanced performance requirements.

PostgreSQL 52

PostgreSQL SQL Data Security Data 52

Data Engineering Podcast

JANUARY 29, 2023

Data analysts create reports that are used by the business to understand and direct the business, but the process is very labor and time intensive. Materialize’s PostgreSQL-compatible interface lets users leverage the tools they already use, with unsurpassed simplicity enabled by full ANSI SQL support.

Business Intelligence 130

Business Intelligence PostgreSQL Building BI 130

Data Engineering Podcast

AUGUST 27, 2023

In this episode Vignesh Ravichandran explains how his team at Cloudflare provides PostgreSQL as a service to their developers for low latency and high uptime services at global scale. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!

Database 130

Database Building PostgreSQL BI 130

Data Engineering Podcast

JANUARY 13, 2019

release, how the use cases for timeseries data have proliferated, and how they are continuing to simplify the task of processing your time oriented events. How have the improvements and new features in the recent releases of PostgreSQL impacted the Timescale product?

Database 100

Database PostgreSQL SQL MongoDB 100

ProjectPro

JUNE 6, 2025

Gaining such expertise can streamline data processing, ensuring data is readily available for analytics and decision-making. Suppose a cloud professional takes a course focusing on using AWS Glue and Apache Spark for ETL (Extract, Transform, Load) processes. Ratings/Reviews This course has an overall rating of 4.7

40

40

DoorDash Engineering

FEBRUARY 7, 2023

It’s hosted in the PostgreSQL and used to serve item metadata to the Dasher, our name for delivery drivers, during order fulfillment. In particular, we noticed slower SQL inserts because all the updates went through a single writer instance. This improved the SQL update performance by over 5X.

PostgreSQL 119

PostgreSQL SQL Retail Database 119

ProjectPro

JUNE 6, 2025

You’ll walk through each stage of the data processing workflow, similar to what’s used in production-grade systems. Extract, Transform, and Load (ETL) is a process that lies at the core of every application, from dashboards to machine learning models. You don’t want to do this manually every day, right?

40

40

Cloudera

MARCH 23, 2023

Cloudera SQL Stream Builder (SSB) gives the power of a unified stream processing engine to non-technical users so they can integrate, aggregate, query, and analyze both streaming and batch data sources in a single SQL interface. The key is one of the fields returned by the SSB SQL query, and it is available from the dropdown.

SQL 81

SQL Kafka PostgreSQL Database 81

Data Engineering Podcast

JANUARY 8, 2023

In this episode Ori Rafael explains how they are automating the creation and scheduling of orchestration flows and their related transforations in a unified SQL interface. What are the benefits of merging the logic for transformation and orchestration into the same interface and dialect (SQL)?

PostgreSQL 130

PostgreSQL Data Lake Data Warehouse BI 130

Monte Carlo

APRIL 8, 2025

Let’s walk through how to build this system step by step, using PostgreSQL examples to make it real and actionable. So before you start writing SQL or labeling columns, it’s important to understand what youre working with. SQL lets you control who can see what with role-based access. What sensitive data does it hide?

PostgreSQL 52

PostgreSQL Medical Database Data 52

Meltano

OCTOBER 19, 2022

PostgreSQL and MySQL are among the most popular open-source relational database management systems (RDMS) worldwide. For all of their similarities, PostgreSQL and MySQL differ from one another in many ways. Since the two platforms are SQL-based, they have a lot in common in terms of syntax.

PostgreSQL 52

PostgreSQL MySQL Database SQL 52

Hevo

SEPTEMBER 26, 2023

To unlock the full potential of your data in PostgreSQL on Google Cloud SQL necessitates data integration with Amazon Aurora. This migration offers several advantages, such as enhanced data processing speed and availability, enabling data-driven […]

Google Cloud 52

Google Cloud PostgreSQL SQL Cloud 52

Data Engineering Podcast

FEBRUARY 11, 2018

release of PostGreSQL had on the design of the project? Is timescale compatible with systems such as Amazon RDS or Google Cloud SQL? release of PostGreSQL had on the design of the project? Is timescale compatible with systems such as Amazon RDS or Google Cloud SQL? What impact has the 10.0 What impact has the 10.0

PostgreSQL 100

PostgreSQL NoSQL Google Cloud MongoDB 100

Knowledge Hut

DECEMBER 21, 2023

In the database ecosystem, Postgres is one of the top open-source databases, and one of the most widely used PSQL tools for managing PostgreSQL is pgAdmin. To run PostgreSQL instances on the Azure cloud, Azure offers Azure Database for PostgreSQL. What are PostgreSQL Tools? Why Use a GUI Tool?

PostgreSQL 52

PostgreSQL MySQL MongoDB SQL 52

Data Engineering Podcast

JANUARY 15, 2023

With a PostgreSQL-compatible interface, you can now work with real-time data using ANSI SQL including the ability to perform multi-way complex joins, which support stream-to-stream, stream-to-table, table-to-table, and more, all in standard SQL. What are the platform capabilities that are required to make it possible?

Coding 130

Coding Building PostgreSQL Data Lake 130

Data Engineering Podcast

APRIL 19, 2020

In this episode Eventador Founder and CEO Kenny Gorman describes how the platform is architected, the challenges inherent to managing reliable streams of data, the simplicity offered by a SQL interface, and the interesting projects that his customers have built on top of it. How does it fit into an application architecture?

Building 100

Building PostgreSQL MongoDB SQL 100

Zalando Engineering

DECEMBER 1, 2021

This blog post explains to you which tools to use to serve geospatial data from a database system (PostgreSQL) to your web browser. At Zalando, the open source database system PostgreSQL is used by many teams and it offers a geospatial component called PostGIS. CREATE OR REPLACE FUNCTION geodata. j , sum ( p. popcount ) * 0.

PostgreSQL 52

PostgreSQL Metadata Database SQL 52

DoorDash Engineering

MARCH 7, 2023

We knew we’d be deploying a Docker container to Fargate as well as using an Amazon Aurora PostgreSQL database and Terraform to model our infrastructure as code. Set up a locally running containerized PostgreSQL database. This isn’t necessary for your application, but it definitely speeds up the development process.

AWS 119

AWS PostgreSQL Database SQL 119

Towards Data Science

FEBRUARY 9, 2024

This involves getting data from an API and storing it in a PostgreSQL database. This first part project is ideal for beginners in data engineering, as well as for data scientists and machine learning engineers looking to deepen their knowledge of the entire data handling process. The first phase focuses on building a data pipeline.

Kafka 98

Kafka Data Engineering Data Engineer PostgreSQL 98

dbt Developer Hub

APRIL 19, 2023

Close alignment with actual business processes : Business processes and metrics are modeled and calculated as part of dimensional modeling. Part 1: Setup dbt project and database ​ Step 1: Install project dependencies ​ Before you can get started: You must have either DuckDB or PostgreSQL installed.

Building 145

Building PostgreSQL BI Database 145

Netflix Tech

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. This motivated the development of DBLog , which offers log and dump processing under a generic framework. Some of DBLog’s features are: Processes captured log events in-order. This way log processing can progress alongside dump processing.

MySQL 91

MySQL PostgreSQL Database Transportation 91

Netflix Tech

DECEMBER 17, 2019

In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. This motivated the development of DBLog , which offers log and dump processing under a generic framework. Some of DBLog’s features are: Processes captured log events in-order. This way log processing can progress alongside dump processing.

MySQL 86

MySQL PostgreSQL Database Transportation 86

Striim

AUGUST 29, 2023

We are proud to announce that Striim has successfully achieved Google Cloud Ready – Cloud SQL Designation for Google Cloud’s fully managed relational database service for MySQL, PostgreSQL, and SQL Server. Striim is committed to providing comprehensive support for Google Cloud services across all industries.

Google Cloud 52

Google Cloud SQL Cloud Designing 52

Rockset

MARCH 1, 2023

The Challenge of Compute Contention At the heart of every real-time application you have this pattern that the data never stops coming in and requires continuous processing, and the queries never stop – whether they come from anomaly detectors that run 24x7 or end-user-facing analytics. So they are not suitable for real-time analytics.

Data Ingestion 144

Data Ingestion Database Architecture SQL 144

Cloudera

JUNE 3, 2022

When it comes to the early stages in the data science process, data scientists often find themselves jumping between a wide range of tooling. Data scientists might want to do some SQL – based profiling, or visualize the data to better understand the distributions, veracity, and hidden nuances.

Data Analysis 92

Data Analysis PostgreSQL Data Science Machine Learning 92

Data Engineering Podcast

MAY 27, 2021

By acting as a virtual hub for data assets ranging from tables and dashboards to SQL snippets & code, Atlan enables teams to create a single source of truth for all their data assets, and collaborate across the modern data stack through deep integrations with tools like Snowflake, Slack, Looker and more.

Data Warehouse 100

Data Warehouse Cloud PostgreSQL Kafka 100