Data Engineering Podcast

APRIL 28, 2019

However, managing the database layer is still a separate concern. In this episode Tamal Saha explains how the KubeDB project got started, why you might want to run your database with Kubernetes, and how to get started. Can you talk through how KubeDB simplifies the process of deploying and maintaining databases?

Database 100

Database PostgreSQL MongoDB MySQL 100

ProjectPro

FEBRUARY 8, 2023

AWS Glue is here to put an end to all your worries! Read this blog to understand everything about AWS Glue that makes it one of the most popular data integration solutions in the industry. Well, AWS Glue is the answer to your problems! In 2023, more than 5140 businesses worldwide have started using AWS Glue as a big data tool.

AWS 98

AWS Scala Metadata Data Lake 98

Knowledge Hut

NOVEMBER 22, 2023

MySQL Database Administrators makes Netflix binging, booking an Uber ride, and shopping on Amazon possible. As the world becomes digital, the demand for proficient database administrators also increases as almost every other application generates and accumulates data. Who is a MySQL Database Administrator?

MySQL 52

MySQL Database Banking Certification 52

Data Engineering Podcast

AUGUST 6, 2022

For machine learning applications relational models require additional processing to be directly useful, which is why there has been a growth in the use of vector databases. Go to dataengineeringpodcast.com/linode today and get a $100 credit to launch a database, create a Kubernetes cluster, or take advantage of all of their other services.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

AUGUST 19, 2018

For a substantial number of use cases, the optimal format for storing and querying that information is as a graph, however databases architected around that use case have historically been difficult to use at scale or for serving fast, distributed queries. Interview Introduction How did you get involved in the area of data management?

Database 100

Database PostgreSQL NoSQL Transportation 100

Data Engineering Podcast

MAY 29, 2022

Singlestore aims to cut down on the number of database engines that you need to run so that you can reduce the amount of copying that is required. By supporting fast, in-memory row-based queries and columnar on-disk representation, it lets your transactional and analytical workloads run in the same database.

Database 100

Database Architecture Data Architecture PostgreSQL 100

Knowledge Hut

NOVEMBER 16, 2023

DBA – MySQL – SQL Server In this highly competitive as well as dynamic Software/IT industry, there is one course the one course, which is very popular and can give you a stable career, DBA. MongoDB Administrator MongoDB is a well-known NO-SQL database.

Technology 98

Technology MySQL MongoDB Google Cloud 98

Christophe Blefari

JUNE 21, 2024

In the data world Snowflake and Databricks are our dedicated platforms, we consider them big, but when we take the whole tech ecosystem they are (so) small: AWS revenue is $80b, Azure is $62b and GCP is $37b. That's what is Unity Catalog , AWS Glue Data Catalog , Polaris , Iceberg Rest Catalog and Tabular (RIP). Here we go again.

Metadata 147

Metadata Data Warehouse BI MySQL 147

Snowflake

JUNE 13, 2024

Snowflake is launching native integrations with some of the most popular databases, including PostgreSQL and MySQL. With other ingestion improvements and our new database connectors, we are smoothing out the data ingestion process, making it radically simple and efficient to bring data to Snowflake.

Data Ingestion 112

Data Ingestion MySQL PostgreSQL Data Pipeline 112

Edureka

SEPTEMBER 3, 2024

Moving databases to the cloud can be a really challenging and risky process, and it can also interrupt business processes. In this blog, you will learn in detail about the AWS DMS service, including its workings, implementation scenarios, and how it can be of value to your business. What is AWS Database Migration Service?

AWS 40

AWS Database MySQL PostgreSQL 40

Striim

MARCH 21, 2025

A streaming ETL for Snowflake approach loads data to Snowflake from diverse sources such as transactional databases, security systems logs, and IoT sensors/devices in real time , while simultaneously meeting scalability, latency, security, and reliability requirements. that provide significant operational value to the business.

Data Warehouse 52

Data Warehouse MongoDB MySQL Hadoop 52

Data Engineering Podcast

NOVEMBER 20, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

Data Lake 130

Data Lake Data Ingestion MongoDB MySQL 130

Hevo

MAY 10, 2024

Organizations often manage operational data using open-source databases like MySQL, frequently deployed on local machines. To enhance data management and security, many organizations prefer deploying these databases on cloud providers like AWS, Azure, or Google Cloud Platform (GCP).

MySQL 52

MySQL Google Cloud AWS SQL 52

Rockset

NOVEMBER 9, 2021

There are multiple change data capture methods available when using a MySQL or Postgres database. Some of these methods overlap and are very similar regardless of which database technology you are using, others are different. Publishers send data to a queue and one or more consumers can then read messages from that queue.

MySQL 52

MySQL Kafka AWS Database 52

Rockset

JULY 1, 2021

Last week , we walked you through how to scale your Amazon RDS MySQL analytical workload with Rockset. This week will continue with the same Amazon RDS MySQL that we created last week, and upload Airbnb data to a new table. Uploading data to Amazon RDS MySQL To get started: Let’s first download the Airbnb CSV file.

MySQL 52

MySQL AWS Data Database 52

Data Engineering Podcast

JUNE 19, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Go to dataengineeringpodcast.com/ascend and sign up for a free trial.

Metadata 130

Metadata MongoDB MySQL Scala 130

Data Engineering Podcast

NOVEMBER 6, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

Data Engineering Podcast

JUNE 12, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Go to dataengineeringpodcast.com/ascend and sign up for a free trial.

Unstructured Data 130

Unstructured Data MongoDB MySQL Scala 130

Netflix Tech

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

MySQL 89

MySQL PostgreSQL Database Transportation 89

nodeSWAT

SEPTEMBER 9, 2019

Story about unexpected slowdown during AWS RDS upgrade to AWS Aurora and InnoDB adaptive hash index parameter TL;DR at the end. Turning this parameter ON enables the database engine to analyze index searches and to automatically adapt to the queries/searches you are running. The parameter.

AWS 52

AWS MySQL Database SQL 52

Netflix Tech

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

MySQL 83

MySQL PostgreSQL Database Transportation 83

Knowledge Hut

NOVEMBER 17, 2023

Amazon Web Services (AWS) delivers on-demand computing resources and facilities in the cloud. AWS offers a pay-as-you-go pricing package which is calculated hourly. These are some of the top products offered by AWS. AWS Lambda With AWS Lambda, you can run codes without having to manage different servers.

AWS 52

AWS Amazon Web Services PostgreSQL Relational Database 52

Data Engineering Podcast

AUGUST 21, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Just connect it to your database/data warehouse/data lakehouse/whatever you’re using and let them do the rest.

Lambda Architecture 100

Lambda Architecture MongoDB MySQL Scala 100

Booking.com Engineering

OCTOBER 18, 2022

The system was simple: Queue, Consumer and Database scheduler for retries. They were engaged in many fire fighting incidents (outages in production), as the process could easily fail due to bugs or transient database errors (temporary issues that resolve themselves). A simple process runs the new property registration workflow.

AWS 52

AWS Building MySQL Database 52

Snowflake

SEPTEMBER 7, 2023

With this announcement, External Access is in public preview on Amazon Web Services (AWS) regions. Airbyte enables customers to continuously load data from external APIs and databases into Snowflake. To access Amazon Bedrock, one can use the short-lived AWS STS credentials to authenticate and access the Amazon Bedrock endpoints.

Amazon Web Services 134

Amazon Web Services AWS Government Python 134

ThoughtSpot

OCTOBER 27, 2023

Every business that analyzes their operational (or transactional) data needs to build a custom data pipeline involving several batch or streaming jobs to extract transactional data from relational databases , transform it, and load it into the data warehouse. Click Continue. Click Create Connections. Click Create. Try it for yourself !

Building 97

Building MySQL Data Warehouse SQL 97

Data Engineering Podcast

OCTOBER 30, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. No more shipping and praying, you can now know exactly what will change in your database!

Engineering 100

Engineering MongoDB MySQL Scala 100

Knowledge Hut

SEPTEMBER 29, 2023

AWS, or Amazon Web Services, need no formal introduction given its enormous popularity. It enables us developers to access more than 170 AWS services from anywhere at any time. An "AWS mind map" is a visual representation or diagram that organizes and depicts the core ideas, services, and components of Amazon Web Services (AWS).

AWS 52

AWS Amazon Web Services Cloud Storage Relational Database 52

Rockset

JUNE 1, 2021

MySQL and PostgreSQL are widely used as transactional databases. When it comes to supporting high-scale and analytical use cases, you may often have to tune and configure these databases, which leads to a higher operational burden. This mitigates the need to tune these relational databases to handle heavy analytical workloads.

MySQL 40

MySQL PostgreSQL AWS Relational Database 40

Monte Carlo

MARCH 6, 2024

If you’ve been keeping track of our integrations page you might have noticed Monte Carlo is adding support for different databases faster than a nested loop server crash. By the end of 2023, we added Azure SQL database to the list as well as enterprise databases such as Oracle DB , SAP HANA and Teradata.

Database 52

Database MySQL Data Warehouse Architecture 52

Data Engineering Podcast

SEPTEMBER 11, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Go to dataengineeringpodcast.com/ascend and sign up for a free trial.

Data Pipeline 130

Data Pipeline Building MongoDB MySQL 130

Data Engineering Podcast

OCTOBER 9, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Metadata 100

Metadata MongoDB AWS MySQL 100

Data Engineering Podcast

OCTOBER 16, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Go to dataengineeringpodcast.com/ascend and sign up for a free trial.

Data Lake 100

Data Lake Food MongoDB MySQL 100

Edureka

JANUARY 21, 2025

It is highly adaptable, as it supports extensions for features such as API development, database integration, and authentication. Define and Access the Database in Flask Flask supports databases like SQLite, MySQL, and PostgreSQL. Task Manager : Design a to-do app with a database backend.

Python 52

Python Building Certification Database 52

Cloudera

SEPTEMBER 28, 2020

Support Kafka connectivity to HDFS, AWS S3 and Kafka Streams. This customer’s workloads leverage batch processing of data from 100+ backend database sources like Oracle, SQL Server, and traditional Mainframes using Syncsort. Postgres 10, MySQL 5.7 Document the operating system versions, database versions, and JDK versions.

Cloud 132

Cloud Kafka Professional Services Metadata 132

Knowledge Hut

SEPTEMBER 24, 2024

Features: Single code base compatible with every major platform Enables to connect to 20+ databases natively via FireDAC's high-paced direct access. SQL Sentry With transparency across the Microsoft data estate and rapid root error analysis, SQL Sentry is a database performance monitoring for all data platforms.

Electronics 98

Electronics MongoDB SQL Java 98

Data Engineering Podcast

AUGUST 13, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Just connect it to your database/data warehouse/data lakehouse/whatever you’re using and let them do the rest.

Metadata 100

Metadata MongoDB MySQL Scala 100