Data Engineering Podcast

MAY 18, 2024

Summary The purpose of business intelligence systems is to allow anyone in the business to access and decode data to help them make informed decisions. The team at Zenlytic have leaned on the promise of large language models to build an AI agent that lets you converse with your data.

Building 278

Building Data Lake High Quality Data Business Intelligence 278

Data Engineering Podcast

MAY 22, 2022

Summary Machine learning has become a meaningful target for data applications, bringing with it an increase in the complexity of orchestrating the entire data flow. Machine learning use cases have been a core focus since the project’s inception. Can you describe what Flyte is and the story behind it?

Machine Learning 130

Machine Learning Data Engineering Data Engineer Cloud 130

ProjectPro

FEBRUARY 16, 2023

Business Intelligence and Artificial Intelligence are popular technologies that help organizations turn raw data into actionable insights. While both BI and AI provide data-driven insights, they differ in how they help businesses gain a competitive edge in the data-driven marketplace.

Business Intelligence 52

Business Intelligence BI Data Mining Algorithm 52

Data Engineering Podcast

APRIL 29, 2018

Summary Business Intelligence software is often cumbersome and requires specialized knowledge of the tools and data to be able to ask and answer questions about the state of the organization. The current goal for most companies is to be “data driven” How would you define that concept?

Business Intelligence 100

Business Intelligence Scala Hadoop Machine Learning 100

Data Engineering Podcast

APRIL 22, 2018

In this episode Amnon Drori, CEO and co-founder of Octopai, discusses the business problems he witnessed that led him to starting the company, how their systems are able to provide valuable tools and insights, and the direction that their product will be taking in the future. What is OctopAI and what was your motivation for founding it?

Business Intelligence 113

Business Intelligence Metadata Management Data Governance 113

Data Engineering Podcast

JULY 17, 2022

In this episode Crux CTO Mark Etherington discusses the different costs involved in managing external data, how to think about the total return on investment for your data, and how the Crux platform is architected to reduce the toil involved in managing third party data.

Data Management 130

Data Management Management Metadata MongoDB 130

Knowledge Hut

JUNE 20, 2023

A novice data scientist prepared to start a rewarding journey may need clarification on the differences between a data scientist and a machine learning engineer. Many people are learning data science for the first time and need help comprehending the two job positions. They develop self-running software.

Machine Learning 52

Machine Learning Data Engineering Data Engineer Engineering 52

AltexSoft

JUNE 26, 2023

While today’s world abounds with data, gathering valuable information presents a lot of organizational and technical challenges, which we are going to address in this article. We’ll particularly explore data collection approaches and tools for analytics and machine learning projects. What is data collection?

Data Collection 52

Data Collection Machine Learning Unstructured Data Non-relational Database 52

Data Engineering Podcast

NOVEMBER 16, 2020

Summary The core mission of data engineers is to provide the business with a way to ask and answer questions of their data. This often takes the form of business intelligence dashboards, machine learning models, or APIs on top of a cleaned and curated data set.

Data Management 100

Data Management Management BI Business Intelligence 100

Data Engineering Podcast

FEBRUARY 5, 2023

Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? The Machine Learning Podcast helps you go from idea to production with machine learning. The Machine Learning Podcast helps you go from idea to production with machine learning.

Data Engineering 147

Data Engineering Data Engineer Engineering PostgreSQL 147

Hevo

NOVEMBER 14, 2024

Databricks Lakehouse is an open data management architecture which combines the scalability, cost-effectiveness, and flexibility of data lakes with the data management and ACID transactions of data warehouses. Databricks Lakehouse is the best of both worlds of data lakes and data warehouses.

Data Lake 40

Data Lake Data Warehouse Business Intelligence Machine Learning 40

Data Engineering Podcast

SEPTEMBER 3, 2018

Summary With the proliferation of data sources to give a more comprehensive view of the information critical to your business it is even more important to have a canonical view of the entities that you care about. Can you start by establishing a definition of data mastering that we can work from?

Data Management 100

Data Management Management Relational Database Business Intelligence 100

Data Engineering Podcast

DECEMBER 18, 2022

In this episode Abe Gong brings his experiences with the Great Expectations project and community to discuss the technical and organizational considerations involved in implementing these constraints to your data workflows. Can you describe what your conception of a data contract is? Closing Announcements Thank you for listening!

Metadata 130

Metadata Business Intelligence Data Lake BI 130

Advancing Analytics: Data Engineering

JULY 2, 2019

It’s not always the most accurate indicator, but a quick glance at google trends sees Data Engineer rocketing in popularity, compared to more traditional functions such as BI and ETL Developer: google trends Now, that’s not saying that the other roles are going away, not by a long stretch.

Business Intelligence 52

Business Intelligence Data Engineering Data Engineer Engineering 52

Data Engineering Podcast

DECEMBER 29, 2022

In this episode she shares the strategic and tactical elements of how to make more effective use of the technical and organizational resources that are available to you for getting work done with data. Trusted by the data teams at Fox, JetBlue, and PagerDuty, Monte Carlo solves the costly problem of broken data pipelines.

Management 130

Management Metadata Business Intelligence Data Lake 130

Knowledge Hut

DECEMBER 29, 2023

Professionals from a variety of disciplines use data in their day-to-day operations and feel the need to understand cutting-edge technology to get maximum insights from the data, therefore contributing to the growth of the organization. A Data Engineer in the Data Science team is responsible for this sort of data manipulation.

Data Science 98

Data Science Data Mining Deep Learning Programming Language 98

Data Engineering Podcast

AUGUST 13, 2023

Summary Data pipelines are the core of every data product, ML model, and business intelligence dashboard. The folks at Rivery distilled the seven principles of modern data pipelines that will help you stay out of trouble and be productive with your data. Closing Announcements Thank you for listening!

Data Pipeline 130

Data Pipeline BI SQL Business Intelligence 130

Data Engineering Podcast

JANUARY 15, 2023

In this episode Srujan Akula explains how the system is implemented and how you can start using it today with your existing data systems. Trusted by the data teams at Fox, JetBlue, and PagerDuty, Monte Carlo solves the costly problem of broken data pipelines. Your flagship (only?) What is the scope and goal of that platform?

Coding 130

Coding Building PostgreSQL Data Lake 130

Knowledge Hut

DECEMBER 26, 2023

Of course, handling such huge amounts of data and using them to extract data-driven insights for any business is not an easy task; and this is where Data Science comes into the picture. Mathematical concepts like Statistics and Probability, Calculus, and Linear Algebra are vital in pursuing a career in Data Science.

Data Science 97

Data Science BI Business Intelligence Machine Learning 97

Data Engineering Podcast

JANUARY 8, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data and analytics leaders, 2023 is your year to sharpen your leadership skills, refine your strategies and lead with purpose. The Machine Learning Podcast helps you go from idea to production with machine learning.

PostgreSQL 130

PostgreSQL Data Lake Data Warehouse BI 130

Knowledge Hut

JANUARY 18, 2024

Top 10 Data Science Jobs for Freshers in 2023 As a fresher, you're probably curious about the various data science career options. This section will help you know the top 10 Data Scientist jobs for freshers. Roles and Responsibilities Design machine learning (ML) systems Select the most appropriate data representation methods.

Data Science 98

Data Science Business Analyst Data Architect ETL Method 98

Data Engineering Podcast

NOVEMBER 13, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Building 130

Building Metadata MongoDB MySQL 130

Data Engineering Podcast

JUNE 19, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Metadata 130

Metadata Unstructured Data MongoDB MySQL 130

Data Engineering Podcast

JUNE 26, 2022

In this episode Isaac Brodsky explains how the Unfolded platform is architected, their experience joining the team at Foursquare, and how you can start using it for analyzing your spatial data today. What are some of the core challenges of working with spatial data? Closing Announcements Thank you for listening!

Datasets 130

Datasets Unstructured Data Metadata MongoDB 130

Data Engineering Podcast

NOVEMBER 27, 2022

In this episode Wes McKinney shares the ways that Arrow and its related projects are improving the efficiency of data systems and driving their next stage of evolution. Trusted by the data teams at Fox, JetBlue, and PagerDuty, Monte Carlo solves the costly problem of broken data pipelines.

Data Process 100

Data Process Process Metadata Business Intelligence 100

Knowledge Hut

NOVEMBER 16, 2023

The demand for SAS – data analytics is growing day-by-day and the business intelligence domain has emerged as one of the most trusted and lucrative options for science graduates. This Professional Certificate will assist anyone interested in a career in data science or machine learning in developing job-related abilities.

Technology 98

Technology MySQL MongoDB Google Cloud 98

Data Engineering Podcast

NOVEMBER 6, 2022

He also describes the considerations involved in bringing behavioral data into your systems, and the ways that he and the rest of the Snowplow team are working to make that an easy addition to your platforms. Can you share your definition of "behavioral data" and how it is differentiated from other sources/types of data?

Building 130

Building IT Metadata MongoDB 130

Data Engineering Podcast

JUNE 12, 2022

In this episode she shares her thoughts and insights on how to be intentional about establishing your own data team. Unstruk handles data versioning, lineage tracking, duplicate detection, consistency validation, as well as enrichment through sources including machine learning models, 3rd party data, and web APIs.

Metadata 100

Metadata Unstructured Data Business Intelligence MongoDB 100

Data Engineering Podcast

NOVEMBER 20, 2022

Summary The majority of blog posts and presentations about data engineering and analytics assume that the consumers of those efforts are internal business users accessing an environment controlled by the business. Can you describe what League of Legends is and the role that data plays in the experience?

Systems 130

Systems Metadata Data Pipeline MongoDB 130

Knowledge Hut

MAY 9, 2024

Data Architect ScyllaDB Data architects play a crucial role in designing an organization's data management framework by assessing data sources and integrating them into a centralized plan. Average Annual Salary of Big Data Engineer A big data engineer makes around $120,269 per year.

Data Science 52

Data Science Data Architect Data Mining Programming Language 52

Data Engineering Podcast

SEPTEMBER 11, 2022

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Systems 100

Systems Metadata Building MongoDB 100

Data Engineering Podcast

OCTOBER 23, 2022

In this episode Shane Gibson shares practical advice and insights from his years of experience as a consultant and engineer working in data about how to adopt agile principles in your data work so that you can move faster and provide more value to the business, while building systems that are maintainable and adaptable.

Project 130

Project Metadata MongoDB MySQL 130

Data Engineering Podcast

JULY 31, 2022

Summary Data lineage is the roadmap for your data platform, providing visibility into all of the dependencies for any report, machine learning model, or data warehouse table that you are working with. Data lineage and metadata systems are a hot topic right now. Closing Announcements Thank you for listening!

IT 100

IT Metadata MongoDB MySQL 100

Data Engineering Podcast

DECEMBER 25, 2022

In order to condense that acquired knowledge into a format that is useful to everyone Scott Hirleman turns the tables in this episode and asks Tobias about the tactical and strategic aspects of his experiences applying those lessons to the work of building a data platform from scratch. Closing Announcements Thank you for listening!

Building 100

Building Metadata Business Intelligence Data Lake 100

Data Engineering Podcast

OCTOBER 16, 2022

In this episode Adrian Kosowski explains how the Pathway product got started, how its design simplifies the creation of data products that support supply chain operations, and how developers can help to build an ecosystem of applications that allow businesses to accelerate their time to insight.

Database 100

Database Metadata MongoDB MySQL 100

Data Engineering Podcast

OCTOBER 2, 2022

In this episode Roambee CEO, Sanjay Sharma, shares the types of questions that companies are asking about their logistics, the technical work that they do to provide ways to answer those questions, and how they approach the challenge of data quality in its many forms. Can you describe what Roambee is and the story behind it?

Metadata 100

Metadata Electronics MongoDB MySQL 100

Data Engineering Podcast

SEPTEMBER 25, 2022

In this episode Tom Baeyens explains their reasons for creating a new syntax for expressing and validating checks for data assets and processes, as well as how to incorporate it into your own projects. What are the ways that reliability is measured for data assets? Can you describe what SodaCL is and the story behind it?

Building 100

Building Metadata MongoDB MySQL 100