Data Engineering Podcast

APRIL 28, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. Go to dataengineeringpodcast.com/dagster today to get started. Your first 30 days are free! Data lakes are notoriously complex.

Building 147

Building Data Lake High Quality Data Machine Learning 147

Analytics Vidhya

FEBRUARY 3, 2023

Introduction Do you find yourself spending too much time managing your machine-learning tasks? Airflow can help you manage your workflow and make your life easier with its monitoring and notifications features. Are you looking for a way to automate and simplify the process?

Systems 214

Systems Building Machine Learning Management 214

Data Engineering Podcast

MAY 5, 2024

In this episode he explains his approach to building AI in a more human-like fashion and the emphasis on learning rather than statistical prediction. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines.

Building 147

Building Data Lake High Quality Data Machine Learning 147

Data Engineering Podcast

FEBRUARY 26, 2023

Jean-Georges Perrin was tasked with designing a new data platform implementation at PayPal and wound up building a data mesh. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Are you tired of dealing with the headache that is the 'Modern Data Stack'? We feel your pain.

Building 147

Building Machine Learning Metadata Data Integration 147

ThoughtSpot

OCTOBER 18, 2024

In the fast-paced world of software development, the efficiency of build processes plays a crucial role in maintaining productivity and code quality. At ThoughtSpot , while Gradle has been effective, the growing complexity of our projects demanded a more sophisticated approach to understanding and optimizing our builds.

Building 52

Building Process Pipeline-centric Database-centric 52

Data Engineering Podcast

OCTOBER 15, 2023

Summary Building streaming applications has gotten substantially easier over the past several years. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. How can you get the best results for your use case? Closing Announcements Thank you for listening!

Process 182

Process Building SQL BI 182

Data Engineering Podcast

JANUARY 28, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Data lakes are notoriously complex. Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? What do you have planned for the future of Scanner?

Data Lake 147

Data Lake Building High Quality Data AWS 147

The Pragmatic Engineer

JULY 20, 2023

In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. So we started to build API specs on top of our API security product. But to close this contract, we’d just spent months building an API spec for this user. We pivoted to API observability in 2020.

Building 204

Building Programming Language Programming Python 204

Data Engineering Podcast

JANUARY 23, 2022

In this episode he shares his career journey, the challenges related to management of data professionals, and the platform design that he and his team have built to power analytics at a large company. He also provides some excellent insights into the factors that play into the build vs. buy decision at different organizational sizes.

Building 100

Building Management Data Pipeline Metadata 100

RandomTrees

NOVEMBER 5, 2024

Good data management in Salesforce provides insight into improving interactions with customers and making business operations easier. In this blog, we will take you through the basic steps that help in managing data effectively in Salesforce. Step 2: Data Entry and Management 2.1. Step 1: Understand Your Data Model 1.1

Management 52

Management Data Utilities Data Validation 52

Data Engineering Podcast

JULY 23, 2023

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

Building 130

Building Machine Learning SQL Python 130

Data Engineering Podcast

AUGUST 27, 2023

In the era of the cloud most developers rely on hosted services to manage their databases, but what if you are a cloud service? Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Introducing RudderStack Profiles. Closing Announcements Thank you for listening!

Database 130

Database Building PostgreSQL BI 130

Snowflake

JUNE 5, 2024

Enterprises can utilize gen AI to extract more value from their data and build conversational interfaces for customer and employee applications. Snowflake Cortex AI is a fully managed service designed to unlock the potential of the technology for everyone within an organization, regardless of their technical expertise.

Coding 89

Coding Building Management Government 89

Tweag

JULY 5, 2023

Buck2 is a from-scratch rewrite of Buck , a polyglot, monorepo build system that was developed and used at Meta (Facebook), and shares a few similarities with Bazel. As you may know, the Scalable Builds Group at Tweag has a strong interest in such scalable build systems. invoke build buck2 build //starlark-rust/starlark 6.

Systems 141

Systems Building Java Programming Language 141

KDnuggets

MARCH 30, 2022

Practical advice for managers and directors who are looking to build AI/ML teams.

Building 105

Building Management 105

Cloudera

NOVEMBER 13, 2024

This acquisition delivers access to trusted data so organizations can build reliable AI models and applications by combining data from anywhere in their environment. Additionally, multiple copies of the same data locked in proprietary systems contribute to version control issues, redundancies, staleness, and management headaches.

Metadata 82

Metadata Management Data Governance Government 82

Engineering at Meta

MAY 22, 2024

In recent years, Meta’s data management systems have evolved into a composable architecture that creates interoperability, promotes reusability, and improves engineering efficiency. A few years ago we embarked on a journey to address these shortcomings by rethinking how our data management systems were designed.

Data Management 91

Data Management Management Data SQL 91

Zalando Engineering

OCTOBER 16, 2024

Introduction Context and Purpose Our team is part of the Transport teams within the Logistics department, where we build and manage software for internal users, including finance teams, warehouses, and, in the future, our third-party partners. Modularity was key to enabling independent feature development and deployment across teams.

Building 68

Building Transportation Coding Designing 68

Confluent

SEPTEMBER 17, 2024

Confluent for VS Code streamlines workflows, accelerates development cycles, and enhances real-time data processing, all within a unified environment.

Building 75

Building Management Coding Data 75

DoorDash Engineering

NOVEMBER 28, 2023

In that spirit — and with a six-year background in the release processes for both the DoorDash and Caviar consumer apps, here is a high-level overview of DoorDash’s mobile release management. Here’s a quick look at how we manage things: We ship a new app version every week, which means we have a release cut weekly.

Management 91

Management Coding Building Process 91

Edureka

OCTOBER 10, 2024

Both project managers and product managers are important for the working of any project. It is essential to identify the difference between a product manager vs project manager to allow creativity and execution. Let us differentiate between product manager and project manager.

Management 40

Management Project Certification Data Analysis 40

Knowledge Hut

APRIL 30, 2024

Management is paramount to making any project successful, irrespective of the industry and the work scope. Moreover, there are varied aspects to manage to ensure successful project delivery. These experts follow well-established principles of project management and efficiently manage the complexities to deliver expected end products.

Project 98

Project Management Certification Programming 98

Knowledge Hut

APRIL 12, 2024

Project management plays a significant role in the success of every organization. It ensures that the project is on track, aids in efficient management of resources, and also keeps the stakeholders know what is project and what's happening in it. What is Project Management Structures, and Why is it Important?

Project 98

Project Management Certification Designing 98

DoorDash Engineering

SEPTEMBER 19, 2023

This success has been heavily influenced by the strength and leadership of our Eng management team; great companies are built by great people who have great managers. First, we spent time talking to current Engineering managers and identifying which existing expectations were still relevant, and which ones were no longer serving us.

Management 81

Management Engineering Programming Technology 81

Knowledge Hut

MAY 2, 2024

IT managers are often bound by limitations and reach a wall with remote working environments. While working remotely is beneficial with benefits such as increased employee productivity, satisfaction levels and is known to increase the company income it also comes with a few challenges to the IT managers. What is working remotely?

IT 98

IT Management Project Building 98

Knowledge Hut

FEBRUARY 19, 2024

Why Stakeholder Management? One of the most critical aspects of project management is doing what’s necessary to develop and control relationships with all individuals that the project impacts. Good stakeholder management is a testimony to your influence in an organization, and a key component of a healthy project environment.

Management 98

Management Certification Project Process 98

Towards Data Science

FEBRUARY 9, 2024

How to build a modern, scalable data platform to power your analytics and data science projects (updated) Table of Contents: What’s changed? Orchestration I mentioned modularity as a core concept of building a modern data platform in my 2021 article, but I failed to emphasize the importance of data orchestration.

Building 78

Building Transportation Data Lake Metadata 78

Knowledge Hut

APRIL 29, 2024

In project management, project scheduling encompasses listing activities, defining milestones and scheduling deliverables for delivery. What is Project Schedule in Project Management? Project scheduling is fundamental for planning and control in project management.

Project 98

Project Management Certification Algorithm 98

Netflix Tech

NOVEMBER 6, 2023

We have built an internal system that allows someone to perform in-video search across the entire Netflix video catalog, and we’d like to share our experience in building this system. Building in-video search To build such a visual search engine, we needed a machine learning system that can understand visual elements.

Building 92

Building Media Machine Learning Utilities 92

U-Next

OCTOBER 25, 2022

Product Management focuses on launching a new product or improving an existing one. Marketing, sales, product development, and business are integrated through product management. Research has shown that good product management can boost profits by 34.2%. . Business Manager vs. Product Manager? Introduction .

Management 40

Management Building Finance Technology 40