Data Engineering Podcast

SEPTEMBER 11, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. The predominant pattern in recent years for collecting and processing data is ELT.

Data Pipeline 130

Data Pipeline Building MongoDB MySQL 130

Data Engineering Podcast

DECEMBER 18, 2022

Summary One of the reasons that data work is so challenging is because no single person or team owns the entire process. This introduces friction in the process of collecting, processing, and using data. What does the negotiation process look like for identifying what needs to be included in a contract?

Metadata 130

Metadata Business Intelligence Data Lake BI 130

Data Engineering Podcast

NOVEMBER 6, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What does the installation and integration process look like for Zingg?

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

Data Engineering Podcast

DECEMBER 11, 2022

Planetscale is a serverless option for your MySQL workloads that lets you focus on your applications without having to worry about managing the database or fight with differences between development and production. That way data engineers and data users can process to their heart’s content without worrying about their cloud bill.

Database 100

Database MySQL Data Lake MongoDB 100

Rockset

FEBRUARY 2, 2022

MongoDB is a top database choice for application development. MongoDB wasn’t originally developed with an eye on high performance for analytics. Developers have formed ingenious solutions for real-time analytical queries on data stored in MongoDB, using in-house solutions or third-party products.

MongoDB 52

MongoDB NoSQL Data Warehouse BI 52

Data Engineering Podcast

JUNE 26, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Rockset

NOVEMBER 9, 2021

There are multiple change data capture methods available when using a MySQL or Postgres database. In this post, we’re going to dive deeper into the different ways you can implement CDC if you have either a MySQL and Postgres database and compare the approaches. To simplify this process we can use Kafka Connect.

MySQL 52

MySQL Kafka AWS Database 52

Data Engineering Podcast

AUGUST 28, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Engineering 100

Data Engineering Data Engineer MongoDB Metadata 100

Data Engineering Podcast

AUGUST 6, 2022

For machine learning applications relational models require additional processing to be directly useful, which is why there has been a growth in the use of vector databases. Go to dataengineeringpodcast.com/linode today and get a $100 credit to launch a database, create a Kubernetes cluster, or take advantage of all of their other services.

Machine Learning 100

Machine Learning Database MySQL PostgreSQL 100

Data Engineering Podcast

JULY 17, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Management 130

Data Management Management Metadata MongoDB 130

Data Engineering Podcast

JULY 24, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What was your process for determining what subject areas to include in the book?

Data Engineering 100

Data Engineering Data Engineer Lambda Architecture Engineering 100

Data Engineering Podcast

JULY 17, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What’s the process for the show (finding guests, topics, etc… recording, publishing)?

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

DECEMBER 28, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. That way data engineers and data users can process to their heart’s content without worrying about their cloud bill.

Data Lake 130

Data Lake Data Warehouse Data Pipeline MongoDB 130

Data Engineering Podcast

DECEMBER 25, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. That way data engineers and data users can process to their heart’s content without worrying about their cloud bill.

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Data Engineering Podcast

APRIL 28, 2019

Can you talk through how KubeDB simplifies the process of deploying and maintaining databases? How does KubeDB help with maintenance processes around upgrading existing databases to newer versions? Can you talk through how KubeDB simplifies the process of deploying and maintaining databases?

Database 100

Database PostgreSQL MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 11, 2022

Ananth Packildurai created Schemata as a way to make the creation of schema contracts a lightweight process, allowing the dependency chains to be constructed and evolved iteratively and integrating validation of changes into standard delivery systems.

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

JULY 3, 2022

While it is straightforward to know whether a synchronization process succeeded, it is not always clear whether every record was copied correctly. What was your motivation for going through the process of releasing your data diff functionality as an open source utility? Great Expectations, Soda SQL, etc.)

Data Integration 100

Data Integration MongoDB MySQL Scala 100

Data Engineering Podcast

JULY 31, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What are some of the novel algorithms that you have had to design to support Arkouda’s objectives?

Data Analysis 100

Data Analysis MongoDB Algorithm MySQL 100

Data Engineering Podcast

AUGUST 6, 2022

In this episode Paolo Platter shares the lessons they have learned in that process, the Data Mesh Boost platform that they have built to reduce some of the boilerplate required to make it successful, and some of the considerations to make when deciding if a data mesh is the right choice for you.

Metadata 100

Metadata MongoDB MySQL Machine Learning 100

Data Engineering Podcast

SEPTEMBER 25, 2022

In this episode Tom Baeyens explains their reasons for creating a new syntax for expressing and validating checks for data assets and processes, as well as how to incorporate it into your own projects. What is your process for evolving the SodaCL dialect in a maintainable and sustainable manner?

Building 100

Building Metadata MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 25, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What are some of the different ways that CDC is implemented in different source systems?

Food 100

Food MongoDB MySQL Scala 100

Knowledge Hut

OCTOBER 27, 2023

This project implements advanced technologies, such as computer vision, machine learning, and natural language processing, to translate sign language gestures into audible or written communication. The Android Local Train Ticketing System includes user registration, payment processing, ticket confirmation, and ticket cancellation features.

Software Engineer 98

Software Engineer Software Engineering Coding Project 98

Data Engineering Podcast

AUGUST 13, 2022

Summary Data engineers have typically left the process of data labeling to data scientists or other roles because of its nature as a manual and process heavy undertaking, focusing instead on building automation and repeatable systems. What are the types of collaboration that need to happen in the data labeling process?

Machine Learning 100

Machine Learning Pipeline-centric Database-centric MongoDB 100

Data Engineering Podcast

AUGUST 13, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Metadata 100

Metadata MongoDB MySQL Scala 100

Data Engineering Podcast

DECEMBER 4, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. That way data engineers and data users can process to their heart’s content without worrying about their cloud bill.

Data Lake 100

Data Lake MongoDB MySQL Data Warehouse 100

Data Engineering Podcast

JUNE 12, 2022

Summary Building a well rounded and effective data team is an iterative process, and the first hire can set the stage for future success or failure. Trupti Natu has been the first data hire multiple times and gone through the process of building teams across the different stages of growth.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Data Engineering Podcast

JUNE 5, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What is the process for integrating Y42 with an organization’s data systems?

MongoDB 100

MongoDB MySQL Data Lake Data Warehouse 100

Data Engineering Podcast

JUNE 5, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Can you describe the process of integrating with Skyflow at the application level?

Data Security 100

Data Security Metadata MongoDB MySQL 100

Data Engineering Podcast

JULY 10, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Data Engineering 100

Data Engineering Data Engineer Engineering MongoDB 100

Data Engineering Podcast

JULY 10, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What is your process for establishing and evaluating selection criteria for any new technologies that you adopt?

Metadata 100

Metadata MongoDB MySQL Machine Learning 100

Data Engineering Podcast

OCTOBER 16, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Who are the target users of the Pathway product and how does it fit into their work?

Database 100

Database Metadata MongoDB MySQL 100

Data Engineering Podcast

NOVEMBER 13, 2022

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. What is your process for evaluating build vs. buy decisions?

MongoDB 100

MongoDB MySQL Google Cloud Scala 100

Data Engineering Podcast

JUNE 26, 2022

Master Data Management (MDM) is the process of building consensus around what the information actually means in the context of the business and then shaping the data to match those semantics. Can you describe the adoption process for an organization that is using Profisee for their MDM? Spark, dbt, Airflow, etc.)

Data Management 100

Data Management Management MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 9, 2022

Summary The core of any data platform is the centralized storage and processing layer. With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs.

Metadata 100

Metadata MongoDB AWS MySQL 100

Data Engineering Podcast

NOVEMBER 27, 2022

Summary The most expensive part of working with massive data sets is the work of retrieving and processing the files that contain the raw information. That way data engineers and data users can process to their heart’s content without worrying about their cloud bill. Pricing for SQLake is simple. Pricing for SQLake is simple.

Data Lake 100

Data Lake Data Warehouse MongoDB Data Pipeline 100

AltexSoft

NOVEMBER 23, 2021

The traditional way of data integration involves consolidating disparate data within a single repository — commonly a data warehouse — via the extract, transform, load (ETL) process. If the transformation step comes after loading (for example, when data is consolidated in a data lake or a data lakehouse ), the process is known as ELT.

Process 69

Process Data Lake Metadata Data Warehouse 69

Knowledge Hut

SEPTEMBER 24, 2024

The process through which programmers make various computer programs is called software development. A software developer has a three-sixty-degree approach to the processes and techniques required for the software to work correctly. Linx If you search for low code IDE and server, Linx is the one for you.

Electronics 98

Electronics MongoDB SQL Java 98