Data Engineering Podcast

DECEMBER 11, 2022

Managing the operational concerns for your database can be complex and expensive, especially if you need to scale to large volumes of data, high traffic, or geographically distributed usage. No more shipping and praying, you can now know exactly what will change in your database! or any other destination you choose.

Database 100

Database MySQL Data Lake MongoDB 100

Data Engineering Podcast

OCTOBER 23, 2022

Summary The database market has seen unprecedented activity in recent years, with new options addressing a variety of needs being introduced on a nearly constant basis. Despite that, there are a handful of databases that continue to be adopted due to their proven reliability and robust features.

Database 100

Database MySQL Cloud MongoDB 100

Data Engineering Podcast

JUNE 22, 2021

Summary The database is the core of any system because it holds the data that drives your entire experience. Andy Pavlo researches autonomous database systems, and out of that research he created OtterTune to find the optimal set of parameters to use for your specific workload. Write some Python scripts to automate it?

Database 100

Database MySQL PostgreSQL Data Warehouse 100

Knowledge Hut

NOVEMBER 22, 2023

MySQL Database Administrators makes Netflix binging, booking an Uber ride, and shopping on Amazon possible. As the world becomes digital, the demand for proficient database administrators also increases as almost every other application generates and accumulates data. Who is a MySQL Database Administrator?

MySQL 52

MySQL Database Banking Certification 52

Hevo

MAY 15, 2023

SQL Server is a popular Database Management System, though it can be an expensive choice in terms of license and support fees. Unlike SQL Server, MySQL is a much cheaper option, even if you opt for an enterprise edition.

MySQL 52

MySQL SQL Database Systems 52

Monte Carlo

MAY 9, 2023

But the reality is, transactional databases remain incredibly popular even in analytics use cases. That’s why we’re excited to announce the Monte Carlo data observability platform now integrates with Postgres , MySQL , and Microsoft SQL Server databases.

MySQL 52

MySQL Database SQL Relational Database 52

Data Engineering Podcast

MAY 29, 2022

Singlestore aims to cut down on the number of database engines that you need to run so that you can reduce the amount of copying that is required. By supporting fast, in-memory row-based queries and columnar on-disk representation, it lets your transactional and analytical workloads run in the same database.

Database 100

Database Architecture Data Architecture PostgreSQL 100

Data Engineering Podcast

AUGUST 6, 2022

For machine learning applications relational models require additional processing to be directly useful, which is why there has been a growth in the use of vector databases. Go to dataengineeringpodcast.com/linode today and get a $100 credit to launch a database, create a Kubernetes cluster, or take advantage of all of their other services.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

JANUARY 5, 2020

Summary Databases are useful for inspecting the current state of your application, but inspecting the history of that data can get messy without a way to track changes as they happen. Debezium handles the ingestion and distribution of database changesets. And don’t forget to thank them for their continued support of this show!

Database 100

Database Kafka PostgreSQL MySQL 100

Pinterest Engineering

NOVEMBER 18, 2024

Change Data Capture (CDC) is a crucial technology that enables organizations to efficiently track and capture changes in their databases. In this blog post, we’ll explore what CDC is, why it’s important, and our journey of implementing Generic CDC solutions for all online databases at Pinterest. What is Change Data Capture?

Kafka 50

Kafka MySQL Database Software Engineering 50

Data Engineering Podcast

AUGUST 19, 2018

For a substantial number of use cases, the optimal format for storing and querying that information is as a graph, however databases architected around that use case have historically been difficult to use at scale or for serving fast, distributed queries. Interview Introduction How did you get involved in the area of data management?

Database 100

Database PostgreSQL NoSQL Transportation 100

Towards Data Science

MARCH 30, 2023

Back To Basics | SQL fundamentals for beginners Image by author, created on canva In order to understand the enterprise data; you have to query it a lot. As usual, we will be using classicmodels MySQL sample database for demonstration, which holds the business data of a car retailer. When I say ‘A lot’, I mean it.

SQL 98

SQL MySQL Retail Data Analysis 98

Hevo

DECEMBER 6, 2023

MySQL is a relational database management system based on the Structured Query Language (SQL), the most widely used language for accessing and managing database records. Under the GNU license, MySQL is open-source and free software. Oracle Corporation backs it up.

MySQL 59

MySQL Relational Database Database SQL 59

Christophe Blefari

JUNE 21, 2024

A UX where you buy a single tool combining engine and storage, where all you have to do is flow data in, write SQL, and it's done. you could write the same pipeline in Java, in Scala, in Python, in SQL, etc.—with From the start, Snowflake has been a straightforward platform: load data, write SQL, period. 3) Spark 4.0

Metadata 147

Metadata Data Warehouse BI MySQL 147

Hevo

MAY 10, 2024

Organizations often manage operational data using open-source databases like MySQL, frequently deployed on local machines. To enhance data management and security, many organizations prefer deploying these databases on cloud providers like AWS, Azure, or Google Cloud Platform (GCP).

MySQL 52

MySQL Google Cloud AWS SQL 52

Hevo

SEPTEMBER 24, 2023

MySQL has remained the most popularly used open-source relational database for many years and continues to maintain its dominant position in the industry. Migrating data from PostgreSQL on Google Cloud SQL to MySQL […] Migrating data from PostgreSQL on Google Cloud SQL to MySQL […]

Google Cloud 52

Google Cloud MySQL PostgreSQL SQL 52

Meltano

OCTOBER 19, 2022

PostgreSQL and MySQL are among the most popular open-source relational database management systems (RDMS) worldwide. For all of their similarities, PostgreSQL and MySQL differ from one another in many ways. Since the two platforms are SQL-based, they have a lot in common in terms of syntax.

PostgreSQL 52

PostgreSQL MySQL Database SQL 52

Striim

MARCH 21, 2025

A streaming ETL for Snowflake approach loads data to Snowflake from diverse sources such as transactional databases, security systems logs, and IoT sensors/devices in real time , while simultaneously meeting scalability, latency, security, and reliability requirements. that provide significant operational value to the business.

Data Warehouse 52

Data Warehouse MongoDB MySQL Hadoop 52

Data Engineering Podcast

JANUARY 22, 2023

Materialize breaks down those barriers with a true cloud-native streaming database - not simply a database that connects to streaming systems. challenges of reliably subsetting data impact of ORMs and bad habits developers get into with database modeling Can you describe how Tonic is implemented?

PostgreSQL 130

PostgreSQL MongoDB MySQL Machine Learning 130

Knowledge Hut

DECEMBER 21, 2023

That is why we have compiled a MySQL tools list to consider in 2024. From powerful query builders to intuitive user interfaces, the top picks are designed to get the most out of your MySQL databases. You can also enroll for the MySQL online course to deepen your knowledge in this fierce market competition. What is MySQL?

MySQL 52

MySQL PostgreSQL SQL Programming Language 52

Confluent

FEBRUARY 12, 2019

One of the most common integrations that people want to do with Apache Kafka ® is getting data in from a database. That is because relational databases are a rich source of events. The existing data in a database, and any changes to that data, can be streamed into a Kafka topic. JDBC drivers. bin/connect-distributed./etc/kafka/connect-distributed.properties.

Kafka 89

Kafka MySQL Bytes Java 89

Cloudera

OCTOBER 6, 2020

The Cloudera Operational Database (COD) is a managed dbPaaS solution available as an experience in Cloudera Data Platform (CDP). It offers multi-modal client access with NoSQL key-value using Apache HBase APIs and relational SQL with JDBC (via Apache Phoenix). All code is in my github repo. Choose your environment and name your DB.

Database 81

Database Building Bytes NoSQL 81

Knowledge Hut

JULY 24, 2023

The future of SQL (Structured Query Language) is a scalding subject among professionals in the data-driven world. Recently, the advent of stream processing has unlocked the door for a new era in database technology. According to recent studies, the global database market will grow from USD 63.4 How is SQL Being Utilized?

Database 52

Database SQL Process NoSQL 52

Netflix Tech

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

MySQL 88

MySQL PostgreSQL Database Transportation 88

Christophe Blefari

JULY 26, 2024

Understand Vector database in Google Sheets — Playful. This is a Google Sheet template that you can copy that will explain you how a vector database works as well as the search. Continuous queries — A way to answer to Snowflake dynamic tables, continuous queries are SQL statements that run continuously.

MySQL 130

MySQL Data PostgreSQL Datasets 130

LinkedIn Engineering

JUNE 26, 2023

Enter Flink We've recently adopted Apache Flink at Linkedin, and Flink SQL has changed the way we think about data pipelines and stream processing. But since the introduction of the Table API and Flink SQL, Flink has evolved to support more general-purpose data pipelines. Flink SQL) for a single runtime (e.g.

Data Pipeline 112

Data Pipeline Kafka SQL MySQL 112

Data Engineering Podcast

JUNE 19, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Data Engineering Podcast

NOVEMBER 6, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

Data Engineering Podcast

NOVEMBER 20, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

Data Lake 130

Data Lake Data Ingestion MongoDB MySQL 130

Knowledge Hut

NOVEMBER 16, 2023

DBA – MySQL – SQL Server In this highly competitive as well as dynamic Software/IT industry, there is one course the one course, which is very popular and can give you a stable career, DBA. MongoDB Administrator MongoDB is a well-known NO-SQL database.

Technology 98

Technology MySQL MongoDB Google Cloud 98

Knowledge Hut

DECEMBER 28, 2023

The answer lies within databases. That is precisely what a database offers— a secure location. "Once "Once the business data have been centralized and integrated, the value of the database is greater than the sum of the preexisting parts." What are Database Management Tools? But where does it all reside?

Database 52

Database MySQL SQL Relational Database 52

Data Engineering Weekly

JULY 21, 2024

[link] Oracle: A Quick Introduction to JavaScript Stored Programs in MySQL I found this very interesting: a javascript engine on top of a database!! The blog compares the advantages of Javascript-stored programs vs. SQL-stored programs. In the data warehouse, the programming abstraction standard is around SQL and dataframes.

Data Engineering 118

Data Engineering Data Engineer Engineering Generalist 118

Hevo

AUGUST 17, 2023

Are you looking to migrate your data from MongoDB Atlas to MySQL? Migrating data from MongoDB Atlas to MySQL can be a complex process, especially when handling large datasets and different database structures. However, moving data from MongoDB Atlas to MySQL can help you leverage SQL querying […]

MongoDB 52

MongoDB MySQL Datasets SQL 52

Netflix Tech

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

MySQL 82

MySQL PostgreSQL Database Transportation 82

Data Engineering Podcast

DECEMBER 28, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Data Engineering Podcast

JULY 8, 2019

ClickHouse is an open source, column-oriented database engine built for interactive analytics with linear scalability. Where does it fit in the database market and how does it compare to other column stores, both open source and commercial? What are some of the advanced capabilities, such as SQL extensions, supported data types, etc.

Data Warehouse 100

Data Warehouse MySQL Hadoop Data Lake 100

ThoughtSpot

OCTOBER 27, 2023

Every business that analyzes their operational (or transactional) data needs to build a custom data pipeline involving several batch or streaming jobs to extract transactional data from relational databases , transform it, and load it into the data warehouse. Click Create new from your Data workspace and select Custom SQL view.

Building 97

Building MySQL Data Warehouse SQL 97