Data Engineering Podcast

NOVEMBER 26, 2023

In this episode Tobias Macey shares his thoughts on the challenges that he is facing as he prepares to build the next set of architectural layers for his data platform to enable a larger audience to start accessing the data being managed by his team. Data lakes are notoriously complex. Rudderstack : ![Rudderstack]([link]

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Cloudera

OCTOBER 12, 2020

Eventador, based in Austin, TX, was founded by Erik Beebe and Kenny Gorman in 2016 to address a fundamental business problem – make it simpler to build streaming applications built on real-time data. This typically involved a lot of coding with Java, Scala or similar technologies.

Cloud 132

Cloud Process Scala Kafka 132

Data Engineering Podcast

OCTOBER 22, 2023

In this episode Ranjith Raghunath shares his thoughts on how to build a strategy for the development, delivery, and evolution of data products. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

BI 162

BI SQL Machine Learning Programming Language 162

Data Engineering Podcast

OCTOBER 8, 2023

In this episode he shares his journey of data collection and analysis and the challenges of automating an intentionally manual industry. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Closing Announcements Thank you for listening!

Insurance 162

Insurance BI SQL Machine Learning 162

Data Engineering Podcast

OCTOBER 1, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

Building 162

Building BI SQL Machine Learning 162

Christophe Blefari

JUNE 21, 2024

you could write the same pipeline in Java, in Scala, in Python, in SQL, etc.—with This enables easier data management and query operations, making it possible to perform SQL-like operations and transactions directly on data files. Databricks sells a toolbox, you don't buy any UX. Here we go again.

Metadata 147

Metadata Data Warehouse BI MySQL 147

Data Engineering Podcast

FEBRUARY 18, 2019

Introduction Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out Linode.

Systems 100

Systems Java Media Algorithm 100

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode she shares the story behind the project, the details of how it is implemented, and how you can use it for your own data projects. The Ascend Data Automation Cloud provides a unified platform for data ingestion, transformation, orchestration, and observability. Who is the target audience for Zingg?

MongoDB 130

MongoDB MySQL Scala Machine Learning 130

Data Engineering Podcast

JULY 23, 2023

In this episode he explains how investing in high performance and operationally simplified streaming with a familiar API can yield significant benefits for software and data teams together. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Building 130

Building Machine Learning SQL Python 130

Data Engineering Podcast

JUNE 12, 2022

In this episode Rod Christensen shares the story behind Aparavi and how you can use it to cut costs and gain value for the long tail of your unstructured data. The Ascend Data Automation Cloud provides a unified platform for data ingestion, transformation, orchestration, and observability.

Unstructured Data 130

Unstructured Data MongoDB MySQL Scala 130

Data Engineering Podcast

NOVEMBER 20, 2022

In this episode CEO and founder Salma Bakouk shares her views on the causes and impacts of "data entropy" and how you can tame it before it leads to failures. The Ascend Data Automation Cloud provides a unified platform for data ingestion, transformation, orchestration, and observability.

Data Lake 130

Data Lake Data Ingestion MongoDB MySQL 130

Knowledge Hut

NOVEMBER 16, 2023

Java or J2E and Its Frameworks Java or J2EE is one of the most trusted, powerful and widely used technology by almost all the medium and big organizations around domains, like banking and insurance, life science, telecom, financial services, retail and much, much more.

Technology 98

Technology MySQL MongoDB Google Cloud 98

Data Engineering Podcast

APRIL 14, 2018

Summary The rate of change in the data engineering industry is alternately exciting and exhausting. Joe Crobak found his way into the work of data management by accident as so many of us do. This led to his creation of the Hadoop Weekly newsletter, which he recently rebranded as the Data Engineering Weekly newsletter.

Data Engineer 100

Data Engineer Data Engineering Engineering Hadoop 100

Knowledge Hut

DECEMBER 26, 2023

Most Popular Programming Certifications C & C++ Certifications Oracle Certified Associate Java Programmer OCAJP Certified Associate in Python Programming (PCAP) MongoDB Certified Developer Associate Exam R Programming Certification Oracle MySQL Database Administration Training and Certification (CMDBA) CCA Spark and Hadoop Developer 1.

Certification 98

Certification Programming MongoDB R (Programming) 98

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 130

Metadata MongoDB MySQL Scala 130

Data Engineering Podcast

NOVEMBER 18, 2018

Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out Linode. What are some of the primary ways that Flink is used?

Process 100

Process Google Cloud Scala Kafka 100

Data Engineering Podcast

DECEMBER 2, 2018

Preamble Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out Linode. Would you still use Java?

Systems 100

Systems Building Kafka Java 100

Data Engineering Podcast

MARCH 11, 2018

Contact Info Website pramodsadalage on GitHub @pramodsadalage on Twitter Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? You first co-authored Refactoring Databases in 2006. You first co-authored Refactoring Databases in 2006.

Database 100

Database MongoDB NoSQL Database Design 100

Edureka

AUGUST 18, 2024

Server-side Programming Language To become a back-end developer, the first skill to master is a server-side programming language such as Node.js (javascript ) Python Ruby Java PHP C# Mastering any one of these programming languages is enough to start your journey with full-stack development (Node.js).

Programming Language 98

Programming Language Java Non-relational Database Database 98

Data Engineering Podcast

SEPTEMBER 11, 2022

In this episode he shares his journey from building a consumer product to launching a data pipeline service and how his frustrations as a product owner have informed his work at Hevo Data. The Ascend Data Automation Cloud provides a unified platform for data ingestion, transformation, orchestration, and observability.

Data Pipeline 130

Data Pipeline Building MongoDB MySQL 130

Data Engineering Podcast

JULY 8, 2018

They also explained how it fits in the broad landscape of data tools, the interesting and challenging aspects of the project, and how to build new extensions. They also explained how it fits in the broad landscape of data tools, the interesting and challenging aspects of the project, and how to build new extensions.

Building 100

Building Transportation Kafka Java 100

Monte Carlo

OCTOBER 31, 2024

Both traditional and AI data engineers should be fluent in SQL for managing structured data, but AI data engineers should be proficient in NoSQL databases as well for unstructured data management.

Data Engineer 52

Data Engineer Data Engineering Engineering Unstructured Data 52

Data Engineering Podcast

AUGUST 18, 2021

In this episode Shevek, CTO of Compilerworks, takes us on an interesting journey through the many technical and social complexities that are involved in evolving your data platform and the system that they have built to make it a manageable task. How are you applying compilers to the challenges of data processing systems?

SQL 100

SQL Programming Language Java Metadata 100

Data Engineering Podcast

DECEMBER 30, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Process 100

Process Building Hadoop Java 100

Data Engineering Podcast

JULY 17, 2022

In this episode Joe Reis, founder of Ternary Data and co-author of "Fundamentals of Data Engineering", turns the tables and interviews the host, Tobias Macey, about his journey into podcasting, how he runs the show behind the scenes, and the other things that occupy his time. Don’t forget to check out our other shows.

Data Engineer 100

Data Engineer Data Engineering Engineering MongoDB 100

Data Engineering Podcast

MARCH 5, 2022

DuckDB is an in-process database engine optimized for OLAP applications to speed up your analytical queries that meets you where you are, whether that’s Python, R, Java, even the web. Sometimes what you really need is an embedded database that is blazing fast for single user workloads. Where did the name come from?

Database 100

Database Data Lake Java Data Engineer 100

Data Engineering Podcast

AUGUST 21, 2022

In this episode Shruti Bhat gives her view on the state of the ecosystem for real-time data and the work that she and her team at Rockset is doing to make it easier for engineers to build those experiences. The Ascend Data Automation Cloud provides a unified platform for data ingestion, transformation, orchestration, and observability.

Lambda Architecture 100

Lambda Architecture MongoDB MySQL Scala 100

AltexSoft

JUNE 7, 2021

Apache Hadoop is an open-source framework written in Java for distributed storage and processing of huge datasets. The keyword here is distributed since the data quantities in question are too large to be accommodated and analyzed by a single computer. Data management and monitoring options. What is Hadoop.

Big Data Tools 98

Big Data Tools Hadoop Big Data Database-centric 98

Data Engineering Podcast

MARCH 2, 2020

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Kafka 100

Kafka Process PostgreSQL MySQL 100

Data Engineering Weekly

OCTOBER 11, 2024

The data world is abuzz with speculation about the future of data engineering and the successor to the celebrated modern data stack. While the modern data stack has undeniably revolutionized data management with its cloud-native approach, its complexities and limitations are becoming increasingly apparent.

Manufacturing 110

Manufacturing Transportation Data Warehouse Unstructured Data 110

Engineering at Meta

MARCH 9, 2023

Meta is introducing Velox, an open source unified execution engine aimed at accelerating data management systems and streamlining their development. Velox helps consolidate and unify data management systems in a manner we believe will be of benefit to the industry. Velox is under active development.

Engineering 76

Engineering Java Data Ingestion Bytes 76

Data Engineering Podcast

FEBRUARY 13, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Coding 100

Coding Engineering Data Pipeline Java 100

Knowledge Hut

DECEMBER 26, 2023

Atlassian also provides Confluence, a data management application for intranet collaboration that works well with Jira. TestRail Most suitable for anyone seeking a comprehensive web-based test case management system. According to the DevTestOps Landscape Survey 2019, TestRail is the most widely used test management platform.

Software Engineering 98

Software Engineering Software Engineer Engineering Java 98

Data Engineering Podcast

DECEMBER 22, 2019

In this episode Frank McSherry, chief scientist of Materialize, explains why it was created, what use cases it enables, and how it works to provide fast queries on continually updated data. We have partnered with organizations such as O’Reilly Media, Corinium Global Intelligence, ODSC, and Data Council.

SQL 100

SQL Engineering Building Java 100

Data Engineering Podcast

MAY 29, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Database 100

Database Architecture Data Architecture PostgreSQL 100

Data Engineering Podcast

JUNE 5, 2022

In this episode Sean Falconer explains the idea of a data privacy vault and how this new architectural element can drastically reduce the potential for making a mistake with how you manage regulated or personally identifiable information. Go to dataengineeringpodcast.com/ascend and sign up for a free trial.

Data Security 100

Data Security Metadata MongoDB MySQL 100

Data Engineering Podcast

JULY 24, 2022

Summary The current stage of evolution in the data management ecosystem has resulted in domain and use case specific orchestration capabilities being incorporated into various tools. In this episode Nick Schrock discusses the importance of orchestration and a central location for managing data systems, the road to Dagster’s 1.0

MongoDB 100

MongoDB MySQL Scala Data Lake 100