Zalando Engineering

DECEMBER 1, 2021

This blog post explains to you which tools to use to serve geospatial data from a database system (PostgreSQL) to your web browser. At Zalando, the open source database system PostgreSQL is used by many teams and it offers a geospatial component called PostGIS. CREATE OR REPLACE FUNCTION geodata. j , sum ( p. popcount ) * 0.

PostgreSQL 52

PostgreSQL Metadata Database SQL 52

Striim

AUGUST 29, 2023

We are proud to announce that Striim has successfully achieved Google Cloud Ready – Cloud SQL Designation for Google Cloud’s fully managed relational database service for MySQL, PostgreSQL, and SQL Server. Striim is committed to providing comprehensive support for Google Cloud services across all industries.

Google Cloud 52

Google Cloud SQL Cloud Designing 52

Data Engineering Podcast

AUGUST 27, 2023

In this episode Vignesh Ravichandran explains how his team at Cloudflare provides PostgreSQL as a service to their developers for low latency and high uptime services at global scale. This is an interesting and insightful look at pragmatic engineering for reliability and scale. With Materialize, you can! Why Postgres?

Database 130

Database Building PostgreSQL BI 130

Data Engineering Podcast

AUGUST 5, 2018

Summary One of the longest running and most popular open source database projects is PostgreSQL. Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline you’ll need somewhere to deploy it, so check out Linode.

PostgreSQL 100

PostgreSQL MySQL Banking Database 100

Knowledge Hut

MARCH 12, 2024

SQL databases are one of the most widely used types of database systems available. SQL is a structured query language that these databases enable users to utilize for data management, retrieval, and storage. A number of SQL databases are available. What is SQL? Structured Query Language is what SQL stands for.

SQL 52

SQL Relational Database PostgreSQL MySQL 52

Data Engineering Weekly

FEBRUARY 4, 2024

Joe Reis: Definition of Data Modeling & What Data Modeling Is not Joe raised a very fundamental question in data engineering. He rightly points out that many data engineers will name any of the modeling techniques as data modeling. Visit rudderstack.com to learn more. What is Data Modeling, and what is not?

Data Engineer 62

Data Engineer Data Engineering Engineering PostgreSQL 62

Data Engineering Podcast

OCTOBER 15, 2023

Decodable was built with a mission of eliminating all of the painful aspects of developing and deploying stream processing systems for engineering teams. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. With Materialize, you can!

Process 182

Process Building SQL BI 182

Towards Data Science

FEBRUARY 9, 2024

This involves getting data from an API and storing it in a PostgreSQL database. This first part project is ideal for beginners in data engineering, as well as for data scientists and machine learning engineers looking to deepen their knowledge of the entire data handling process. org.apache.spark:spark-sql-kafka-0-10_2.12:3.5.0",

Kafka 71

Kafka Data Engineer Data Engineering PostgreSQL 71

Data Engineering Podcast

JANUARY 22, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Truly leveraging and benefiting from streaming data is hard - the data stack is costly, difficult to use and still has limitations. Go to dataengineeringpodcast.com/materialize today and sign up for early access to get started.

PostgreSQL 130

PostgreSQL MongoDB MySQL Machine Learning 130

Data Engineering Podcast

FEBRUARY 11, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Truly leveraging and benefiting from streaming data is hard - the data stack is costly, difficult to use and still has limitations. Go to dataengineeringpodcast.com/materialize today and sign up for early access to get started.

PostgreSQL 130

PostgreSQL SQL Machine Learning Data Warehouse 130

Knowledge Hut

NOVEMBER 19, 2023

As a result, data engineers working with big data today require a basic grasp of cloud computing platforms and tools. In this article, I have highlighted a handful of the popular Azure data engineering tools and services. What Are Azure Data Engineer Tools? Please browse through them.

Data Engineer 52

Data Engineer Data Engineering Engineering PostgreSQL 52

Data Engineering Podcast

JANUARY 29, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Truly leveraging and benefiting from streaming data is hard - the data stack is costly, difficult to use and still has limitations. Go to dataengineeringpodcast.com/materialize today and sign up for early access to get started.

Business Intelligence 130

Business Intelligence Building PostgreSQL BI 130

Cloudera

MARCH 23, 2023

Cloudera SQL Stream Builder (SSB) gives the power of a unified stream processing engine to non-technical users so they can integrate, aggregate, query, and analyze both streaming and batch data sources in a single SQL interface. The key is one of the fields returned by the SSB SQL query, and it is available from the dropdown.

SQL 80

SQL Kafka PostgreSQL Database 80

Data Engineering Podcast

JANUARY 7, 2018

Summary PostGreSQL has become one of the most popular and widely used databases, and for good reason. In this episode Ozgun Erdogan, the CTO of Citus, and Craig Kerstiens, Citus Product Manager, discuss how the company got started, the work that they are doing to scale out PostGreSQL, and how you can start using it in your environment.

PostgreSQL 100

PostgreSQL Big Data NoSQL Data 100

Ascend.io

SEPTEMBER 14, 2023

The rise of data-intensive operations has positioned data engineering at the core of today’s organizations. As the demand to efficiently collect, process, and store data increases, data engineers have started to rely on Python to meet this escalating demand. Why Python for Data Engineering?

Data Engineer 52

Data Engineer Data Engineering Python Engineering 52

Cloudera

JULY 16, 2021

Today, we are pleased to announce the general availability of HPL/SQL integration in CDW public cloud. You can now define Hive stored procedures using the HPL/SQL to perform a set of SQL statements (DDLs & DMLs), control-of-flow language. These Hive stored procedures are stored in the Hive MetaStore (HMS).

Data Warehouse 119

Data Warehouse SQL PostgreSQL MySQL 119

Rockset

NOVEMBER 5, 2021

Summary: DataBrain, a SaaS company, was using PostgreSQL through Amazon RDS to land and query incoming customer data. However, PostgreSQL couldn’t scale, quickly ingest schemaless data, or efficiently run analytics as DataBrain’s data grew. PostgreSQL in the cloud was also straightforward to set up and well-established as a technology.

PostgreSQL 52

PostgreSQL Structured Data Data Lake Data Ingestion 52

Christophe Blefari

FEBRUARY 23, 2024

This week I've participated to a round table about data and did a cool presentation about Engines. The idea was to depict the history of engines over the last 40 years and what leads to polars and DuckDB. Engines evolution (me) There are 3 points that have triggered discussion about the visualisation I done What about Arrow?

Data Lake 130

Data Lake PostgreSQL MongoDB Scala 130

Data Engineering Podcast

JANUARY 8, 2023

In this episode Ori Rafael explains how they are automating the creation and scheduling of orchestration flows and their related transforations in a unified SQL interface. Data engineers struggling with unreliable data need look no further than Monte Carlo, the leading end-to-end Data Observability Platform! Stale dashboards?

PostgreSQL 130

PostgreSQL Data Lake Data Warehouse BI 130

Edureka

FEBRUARY 9, 2023

Azure Data Engineering is a rapidly growing field that involves designing, building, and maintaining data processing systems using Microsoft Azure technologies. As a certified Azure Data Engineer, you have the skills and expertise to design, implement and manage complex data storage and processing solutions on the Azure cloud platform.

Data Engineer 52

Data Engineer Data Engineering Engineering Amazon Web Services 52

Data Engineering Podcast

JANUARY 13, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. A growing trend in database engines (e.g.

SQL 100

SQL PostgreSQL MongoDB Database 100

Edureka

OCTOBER 15, 2024

It is easy to use for MySQL and PostgreSQL. Amazon Aurora is a relational database engine compatible with MySQL and PostgreSQL. Aurora is five times faster than MySQL and three times faster than PostgreSQL. RDS works with several databases, like MySQL and PostgreSQL. You will learn how it differs from Amazon RDS.

PostgreSQL 52

PostgreSQL MySQL AWS Relational Database 52

DoorDash Engineering

FEBRUARY 7, 2023

To address these scalability issues we did a major overhaul of the legacy architecture and adopted CockroachDB as its new storage engine. It’s hosted in the PostgreSQL and used to serve item metadata to the Dasher, our name for delivery drivers, during order fulfillment. This improved the SQL update performance by over 5X.

PostgreSQL 119

PostgreSQL SQL Retail Database 119

Data Engineering Podcast

JANUARY 15, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Truly leveraging and benefiting from streaming data is hard - the data stack is costly, difficult to use and still has limitations. Go to dataengineeringpodcast.com/materialize today and sign up for early access to get started.

Coding 130

Coding Building PostgreSQL Data Lake 130

Data Engineering Weekly

JULY 2, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack Profiles takes the SaaS guesswork, and SQL grunt work out of building complete customer profiles, so you can quickly ship actionable, enriched data to every downstream team. So, let's shape the future of Data Engineering together. See how it works today.

Data Engineer 52

Data Engineer Data Engineering Engineering Pipeline-centric 52

Data Engineering Weekly

FEBRUARY 12, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. Data Engineering Weekly readers can use the DataWeekly20 promo code to get a 20% discount on the ticket price.

Data Engineer 52

Data Engineer Data Engineering Engineering Hadoop 52

Rockset

SEPTEMBER 3, 2020

Offloading read operations to another database, such as PostgreSQL, is one option that accomplishes this end. After discussing what PostgreSQL is, this article will look at how to offload read operations to it. What Is PostgreSQL? PostgreSQL is an open-source relational database that has been around for almost three decades.

MongoDB 40

MongoDB PostgreSQL SQL Database 40

Christophe Blefari

JUNE 16, 2023

I'm now under the Berlin rain with 20° When I write in these conditions I feel like a tortured author writing a depressing novel while actually today I'll speak about the AI Act, Python, SQL and data platforms. The ultimate SQL guide — After the last canva on data interviews, here's a canva to learn SQL.

Programming Language 130

Programming Language SQL PostgreSQL Data 130

Rockset

APRIL 15, 2021

Rockset replicates the data in real-time from your primary database, including both the initial full-copy data replication into Rockset and staying in sync by continuously reading your MySQL or PostgreSQL change streams.

PostgreSQL 40

PostgreSQL MySQL Relational Database NoSQL 40

Data Engineering Podcast

JANUARY 13, 2019

Introduction Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out Linode.

Database 100

Database PostgreSQL SQL MongoDB 100

Christophe Blefari

JULY 26, 2024

Joe is a great speaker, he wrote Fundamentals of Data Engineering , which is one of the bibles in data engineering and I can't wait to hear him at Forward Data. Continuous queries — A way to answer to Snowflake dynamic tables, continuous queries are SQL statements that run continuously.

MySQL 130

MySQL Data PostgreSQL Datasets 130

Data Engineering Weekly

JUNE 18, 2023

Data Engineering Weekly Is Brought to You by RudderStack RudderStack provides data pipelines that make it easy to collect data from every application, website, and SaaS platform, then activate it in your warehouse and business tools. SQL, in theory, should be a standard, but unfortunately, that is not the case in the real world.

Data Engineer 52

Data Engineer Data Engineering Engineering MySQL 52

Rockset

JULY 6, 2022

Typically stored in SQL statements, the schema also defines all the tables in the database and their relationship to each other. Companies carefully engineered their ETL data pipelines to align with their schemas (not vice-versa). SQL queries were easier to write. Changing schemas was difficult and rarely done.

NoSQL 52

NoSQL SQL Systems PostgreSQL 52

Data Science Blog: Data Engineering

DECEMBER 23, 2022

Warum Data Engineering der Data Science in Bedeutung und Berufschancen längst die Show stiehlt, dabei selbst ebenso einem stetigen Wandel unterliegt. Was ein Data Engineer wirklich können muss Der Data Scientist als sexiest Job des 21. Data Engineer, der gefragteste Job des 21sten Jahrhunderts? Jahrhunderts?

Data Engineer 52

Data Engineer Data Engineering Engineering Business Intelligence 52

DoorDash Engineering

MARCH 7, 2023

While most engineering tooling at DoorDash is focused on making safe incremental improvements to existing systems, in part by testing in production (learn more about our end-to-end testing strategy ), this is not always the best approach when launching an entirely new business line. Set up a locally running containerized PostgreSQL database.

AWS 119

AWS PostgreSQL Database SQL 119

Knowledge Hut

NOVEMBER 28, 2023

The contemporary world experiences a huge growth in cloud implementations, consequently leading to a rise in demand for data engineers and IT professionals who are well-equipped with a wide range of application and process expertise. Data Engineer certification will aid in scaling up you knowledge and learning of data engineering.

Data Engineer 52

Data Engineer Data Engineering Engineering Generalist 52

Data Engineering Podcast

APRIL 19, 2020

In this episode Eventador Founder and CEO Kenny Gorman describes how the platform is architected, the challenges inherent to managing reliable streams of data, the simplicity offered by a SQL interface, and the interesting projects that his customers have built on top of it. How does it fit into an application architecture?

Building 100

Building PostgreSQL MongoDB SQL 100