Data Engineering Podcast

JULY 19, 2021

In this episode Gleb Mezhanskiy shares some strategies for adding quality checks at every stage of your development and deployment workflow to identify and fix problematic changes to your data before they get to production. What are the biggest factors that you see contributing to data quality issues?

Management 100

Management Data Warehouse Data Pipeline Data 100

Data Engineering Podcast

JANUARY 23, 2022

Ashish Mrig currently leads the data analytics platform for Wayfair, as well as running a local data engineering meetup. In this episode he shares his career journey, the challenges related to management of data professionals, and the platform design that he and his team have built to power analytics at a large company.

Building 100

Building Management Data Pipeline Metadata 100

Data Engineering Podcast

JULY 12, 2021

Summary We have been building platforms and workflows to store, process, and analyze data since the earliest days of computing. Over that time there have been countless architectures, patterns, and "best practices" to make that task manageable. Can you start by giving your definition of the modern data stack?

Designing 100

Designing Data Warehouse Data Governance Architecture 100

Data Engineering Podcast

JUNE 9, 2019

He also describes the Hydrosphere platform, and how the different components work together to manage the full machine learning lifecycle of model deployment and retraining. We have partnered with organizations such as O’Reilly Media, Dataversity, and the Open Data Science Conference.

Machine Learning 100

Machine Learning Management Scala Data Science 100

Striim

JULY 10, 2024

From forecasting demand to managing operational risks, predictive analytics provides invaluable insights that empower organizations to make data-driven decisions in real-time. Accurate predictions require seamless data integration, ensuring timeliness, completeness, and consistency. What are Predictive Analytics in Logistics?

Management 52

Management Transportation Machine Learning High Quality Data 52

Knowledge Hut

APRIL 23, 2024

We live in a data-driven culture where familiarity with databases is crucial. Database management is crucial for businesses of all sizes to guarantee that their data is complete, safe, and easily available when needed. Why are Database Management Skills Important? This is where skills in databases are required.

Database 52

Database Management Relational Database SQL 52

Data Engineering Podcast

JULY 5, 2021

Summary At the core of every data pipeline is an workflow manager (or several). Deploying, managing, and scaling that orchestration can consume a large fraction of a data team’s energy so it is important to pick something that provides the power and flexibility that you need.

Systems 100

Systems Management Data Warehouse Programming Language 100

Data Engineering Podcast

AUGUST 24, 2020

The key to those solutions is a robust and flexible metadata management system. In this episode Mars Lan and Pardhu Gunnam explain how they designed the platform, how it integrates into their data platforms, and how it is being used to power data discovery and analytics at LinkedIn.

Metadata 100

Metadata Management Kafka Data Engineering 100

Knowledge Hut

JANUARY 9, 2024

As businesses are becoming more complex, the need for software systems that can help them manage their operations has taken the first place. As the demand for SAP is growing, SAP project managers with the right skills and experience are becoming a priority. Who is a SAP Project Manager and What do They Do?

Project 52

Project Management Certification Portfolio 52

Data Engineering Podcast

MARCH 29, 2021

They explain how they started down the path of building a solution for managing data quality, their philosophy of how to empower data engineers with well engineered open source tools that integrate with the rest of the platform, and how to bring all of the stakeholders onto the same page to make your data great.

Management 100

Management Data Warehouse BI Data 100

U-Next

JUNE 27, 2022

The product manager job description isn’t enough to get to know the job in detail. You should also enlighten yourself on the functions of a product manager, roles and responsibilities. Introduction Product Manager Roles And Responsibilities. What product management is? What a product manager does?

Management 52

Management Finance Designing Engineering 52

Data Engineering Podcast

JUNE 29, 2020

This was a great conversation about the complexities of working in a niche domain of data analysis and how to build a pipeline of high quality data from collection to analysis. If you hand a book to a new data engineer, what wisdom would you add to it? Can you describe how your overall data management system is architected?

Data Collection 100

Data Collection Management High Quality Data Metadata 100

Hevo

SEPTEMBER 10, 2024

Nowadays, when it comes to data management, every business has to make one critical decision: whether to use a Data Mesh or a Data Warehouse. Both are strong data management architectures, but they are designed to support different needs and various organizational structures.

Data Warehouse 52

Data Warehouse Architecture Data Architecture Data 52

Cloudera

FEBRUARY 11, 2019

The January 2019 “Magic Quadrant for Data Management Solutions for Analytics” provides valuable insights into the status, direction, and players in the DMSA market. 3. Expansion beyond core data management. It accomplishes this while avoiding issues around interoperability among the workloads.

Data Management 43

Data Management Management Metadata Government 43

Cloudera

MARCH 27, 2019

As the CDF platform evolves to address more sophisticated use cases, we are super thrilled to announce two new products within the platform – Cloudera Flow Management and Cloudera Edge Management. Cloudera Flow Management (CFM) is a no-code data ingestion and management solution powered by Apache NiFi.

Management 72

Management Data Ingestion Machine Learning Java 72

Snowflake

FEBRUARY 14, 2024

The data market is fragmented from an architectural perspective, thanks to the emergence of separate data management architectures, and the impact of generative AI on talent and technology is unprecedented. Or in some cases the historical data used in training may simply be too old to produce any equitable results.

Architecture 113

Architecture Government Data Management Management 113

Data Engineering Podcast

FEBRUARY 26, 2023

Jean-Georges Perrin was tasked with designing a new data platform implementation at PayPal and wound up building a data mesh. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Are you tired of dealing with the headache that is the 'Modern Data Stack'?

Building 147

Building Metadata Machine Learning Data Integration 147

Precisely

JUNE 24, 2024

His key takeaways from the conversation were that “ data leaders are under tremendous pressure to collaborate within the C-Suite on projects that deliver true business value. The concept of federated data governance sparked vigorous discussion.

Food 94

Food Data Analytics Pharmaceutical Consulting 94

Data Engineering Podcast

SEPTEMBER 3, 2023

In this episode Adrian Brudaru explains how it works, the benefits that it provides over other data integration solutions, and how you can start building pipelines today. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Data Integration 162

Data Integration BI SQL Python 162

The Modern Data Company

JULY 29, 2024

This dramatic increase in vendors hasn’t led to the expected data revolution. Rather, it has created needlessly complex data architectures that are inflexible, resist change, and stifle innovation. The key lies in building a nimble data ecosystem that can pivot on a dime, adapting to new business needs as quickly as they arise.

Data Architecture 52

Data Architecture Architecture Building Pipeline-centric 52

Data Engineering Podcast

JULY 2, 2023

In this episode Razi Raziuddin shares how data engineering teams can support the machine learning workflow through the development and support of systems that empower data scientists and ML engineers to build and maintain their own features. What is the role of the data engineer in supporting those interfaces?

Machine Learning 130

Machine Learning Data Engineering Data Engineer Engineering 130

Knowledge Hut

SEPTEMBER 22, 2023

In the healthcare and pharmaceutical fields, Clinical Project Managers (CPMs) play a vital role in making sure that research and clinical trials run smoothly. They need a special mix of project management skills and deep knowledge about rules and science. Who is a Clinical Project Manager and What Do They Do?

Project 52

Project Medical Management Pharmaceutical 52

Knowledge Hut

FEBRUARY 27, 2023

Due to rapid globalization, constant business competition, and the emergence of new markets, the role of a project manager is growing in every field of work. As per a report from PMI, on average, India alone will need more than 70K professional project managers annually in the coming decade to meet industry needs.

Project 52

Project Management Consulting Certification 52

ArcGIS

FEBRUARY 22, 2024

The tools in these two extensions are enhanced and incorporated in ArcGIS Pro to support your airport, charting, data management, migration, and design needs.

Designing 78

Designing Data Management Management Transportation 78

Data Engineering Podcast

JULY 9, 2023

In this episode Maxime Beauchemin of Airflow and Superset fame shares his vision for the entity-centric data model and how you can incorporate it into your own warehouse design. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles.

Database-centric 130

Database-centric Machine Learning SQL Data Engineering 130

Knowledge Hut

JANUARY 18, 2024

This section will help you know the top 10 Data Scientist jobs for freshers. Machine Learning Engineers Machine learning engineers are technically skilled programmers whose job is to research, develop, and design self-running software for automating prediction models. Ensure collecting, storage, and analysis of data is accurate.

Data Science 98

Data Science Business Analyst Data Architect ETL Method 98

Snowflake

APRIL 8, 2024

BigGeo BigGeo accelerates geospatial data processing by optimizing performance and eliminating challenges typically associated with big data. Implentio Implentio is a centralized tool that helps ecommerce ops and finance teams efficiently and cost-effectively manage fulfillment and logistics spending.

Pipeline-centric 131

Pipeline-centric Food Healthcare Unstructured Data 131

Edureka

AUGUST 18, 2024

Therefore, front-end, back-end, and database management are the three basic technologies that one needs to be proficient in to become a successful full-stack developer. Some of the best testing tools are: Data Factory Data GeneraTurboTaxData 10. The topics that will be covered in this article are Who is a Full Stack Developer?

Programming Language 98

Programming Language Java Non-relational Database Database 98

The Modern Data Company

APRIL 15, 2024

It’s tailored for leaders who want to optimize their organization’s data use. Understanding Data’s Foundation Data modeling isn’t the first step in managing your company’s data; it’s more like a crucial phase that comes after several foundational layers.

Government 52

Government Metadata Data Data Lake 52

The Modern Data Company

FEBRUARY 2, 2024

This efficiency doesn’t just speed things up; it fundamentally changes how swiftly and effectively you can harness the power of your data assets. These data products are not mere collections of data; they are ready-to-use, trustworthy resources that fundamentally change the game.

Raw Data 75

Raw Data Utilities Government Data 75

Ascend.io

JULY 3, 2024

DataOps, short for Data Operations, integrates data engineering, data quality, and management with agile and DevOps practices. This methodology emphasizes automation, collaboration, and continuous improvement, ensuring faster, more reliable data workflows. The result?

Data Workflow 52

Data Workflow Data Pipeline Data Data Engineering 52

U-Next

DECEMBER 2, 2022

The role of AI in business and management is indispensable. An organization that adopts and invests in Artificial Intelligence technology is going to need to evolve a new management style that combines a leader’s vision with a scientist’s expertise over a growing body of specialized knowledge. Enhanced Monitoring .

Management 40

Management Recruitment Finance Data Mining 40

Data Engineering Podcast

APRIL 14, 2024

In this episode Oren Eini, CEO and creator of RavenDB, explores the nuances of relational vs. non-relational engines, and the strategies for designing a non-relational database. How have the evolution in data formats (e.g. When designing and building a database, what are the initial set of questions that need to be answered?

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Striim

SEPTEMBER 11, 2024

Data pipelines are the backbone of your business’s data architecture. Implementing a robust and scalable pipeline ensures you can effectively manage, analyze, and organize your growing data. Then, we’ll dive deeper into how to build data pipelines and why it’s imperative to make your data pipelines work for you.

Data Pipeline 98

Data Pipeline Designing Data Lake Data Warehouse 98

Data Engineering Weekly

AUGUST 6, 2024

CDC Evaluation Guide Google Sheet Link: [link] CDC Evaluation Guide Github Link: [link] Change Data Capture (CDC) is a powerful technology in data engineering that allows for continuously capturing changes (inserts, updates, and deletes) made to source systems. The Schema evolution management pushes to the pipeline code to manage.

Data Lake 117

Data Lake Data Warehouse Database Data Architecture 117

Cloudera

MAY 30, 2024

In this context, Cloudera and TAI Solutions have partnered to help financial services customers accelerate their data-driven transformation, improve customer centricity, ensure compliance with regulations, enhance risk management, and drive innovation.

Data Analytics 83

Data Analytics Banking Insurance Finance 83

Confluent

AUGUST 31, 2023

Learn how Confluent’s cloud-native Apache Kafka engine stood out from other data management systems with its uniquely elastic, reliable, and cost-efficient design

Kafka 88

Kafka Cloud Designing Data Management 88