Data Engineering Podcast

MARCH 5, 2023

It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. By bringing all the layers of the data stack together, TimeXtender helps you build data solutions up to 10 times faster and saves you 70-80% on costs. Can you describe what your working definition of "Data Culture" is?

Building 147

Building Machine Learning Database Design Metadata 147

Tweag

JULY 5, 2023

Buck2 is a from-scratch rewrite of Buck , a polyglot, monorepo build system that was developed and used at Meta (Facebook), and shares a few similarities with Bazel. As you may know, the Scalable Builds Group at Tweag has a strong interest in such scalable build systems. invoke build buck2 build //starlark-rust/starlark 6.

Systems 141

Systems Building Java Programming Language 141

Data Engineering Podcast

FEBRUARY 18, 2024

Multiple open source projects and vendors have been working together to make this vision a reality. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. Your first 30 days are free!

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Knowledge Hut

NOVEMBER 20, 2023

The DevOps lifecycle phases are in order from left to right, with each phase building upon the last. It is about automating the process of building, testing, deploying, and maintaining applications to reduce time-to-market for new features and functionality. Code - During this point, the code is being developed.

Utilities 97

Utilities Programming Coding Designing 97

Data Engineering Podcast

NOVEMBER 6, 2022

In this episode Nick King discusses how you can be intentional about data creation in your applications and services to reduce the friction and errors involved in building data products and ML applications. Can you share your definition of "behavioral data" and how it is differentiated from other sources/types of data?

Building 130

Building IT Metadata MongoDB 130

Data Engineering Podcast

MARCH 27, 2022

Privacera is an enterprise grade solution for cloud and hybrid data governance built on top of the robust and battle tested Apache Ranger project. Signup for the SaaS product at dataengineeringpodcast.com/acryl RudderStack helps you build a customer data platform on your warehouse or data lake.

Data Governance 130

Data Governance Government Cloud Building 130

dbt Developer Hub

APRIL 19, 2023

This tutorial aims to solve this by providing the definitive guide to dimensional modeling with dbt. Part 1: Setup dbt project and database ​ Step 1: Install project dependencies ​ Before you can get started: You must have either DuckDB or PostgreSQL installed. or above installed You must have dbt version 1.3.0

Building 145

Building PostgreSQL BI Database 145

Towards Data Science

JANUARY 27, 2025

How to Build a Data Dashboard Prototype with Generative AI A book reading data visualization withVizro-AI This article is a tutorial that shows how to build a data dashboard to visualize book reading data taken from goodreads.com. Its still not complete and can definitely be extended and improved upon.

Building 53

Building Datasets Coding Data 53

Knowledge Hut

APRIL 16, 2024

Over the years I have found that my most popular blog posts are those that speak to entry-level project managers. Project management is a vast practice area and for somebody who has only recently started managing projects , it can seem overwhelming. That is true for all projects irrespective of the type of methodology they use.

Project 97

Project Management Certification Process 97

The Pragmatic Engineer

OCTOBER 10, 2023

He’s solved interesting engineering challenges along the way, too – like building observability for Amazon’s EC2 offering, and being one of the first engineers on Uber’s observability platform. They called it Office 365, and in 2010, this was a really exciting project to work on.

Software Engineer 327

Software Engineer Software Engineering Architecture Media 327

Knowledge Hut

JANUARY 25, 2024

With over a decade of my experience in Project management, I might have crashed about 80% of my Project. Project Crashing is not a negative or a bad thing like it sounds, instead it serves as a strategy in project management, aimed at expediting project timelines without compromising the project's scope.

Project 98

Project Management Process Certification 98

Knowledge Hut

APRIL 29, 2024

In project management, project scheduling encompasses listing activities, defining milestones and scheduling deliverables for delivery. This indicates that every project schedule must include a planned start date and planned finish date, estimated resources assigned to each activity and estimated duration of each activity.

Project 98

Project Management Certification Algorithm 98

Knowledge Hut

OCTOBER 23, 2023

Both the project leader and project manager roles are crucial to a project's success if project management is your area of interest as a career. Research and introspection are required to comprehend and decide which role is best for you, especially if you are interested in pursuing a career in project management.

Project 98

Project Management Generalist Algorithm 98

The Pragmatic Engineer

JUNE 22, 2023

The press release: “Squarespace announced today it has entered into a definitive asset purchase agreement with Google, whereby Squarespace will acquire the assets associated with the Google Domains business, which will be winding down following a transition period. ” So what’s being sold, exactly?

Google Cloud 304

Google Cloud Media Cloud Engineering 304

Knowledge Hut

JUNE 26, 2023

Having knowledge of real-world software applications or projects are very essential for any projects for backend developers aspiring software engineers or developers. The portfolio projects showcase their talents and skills whenever they try to look for new opportunities and jobs. What are Backend Development Projects?

Portfolio 98

Portfolio Project Food Media 98

Cloudera

NOVEMBER 13, 2024

This acquisition delivers access to trusted data so organizations can build reliable AI models and applications by combining data from anywhere in their environment. This dampens confidence in the data and hampers access, in turn impacting the speed to launch new AI and analytic projects.

Metadata 90

Metadata Management Data Governance Government 90

Knowledge Hut

FEBRUARY 1, 2024

Today, we’ll talk about how Machine Learning (ML) can be used to build a movie recommendation system - from researching data sets & understanding user preferences all the way through training models & deploying them in applications. How to Build a Movie Recommendation System in Python?

Systems 98

Systems Entertainment Algorithm Datasets 98

Knowledge Hut

MARCH 23, 2023

Project management is vital to the success of any company. It is responsible for keeping all project details organized, prioritized, and on track to meet deadlines and ensure quality. It also has a lot of influence over whether or not a project is completed successfully. What are Project Management Terms?

Project 98

Project Management Systems Process 98

Knowledge Hut

JANUARY 2, 2024

You will learn how to build up Kube-state-metrics system, pull and collect metrics, deploy a Prometheus server and metrics exporters, configure alerts with Alertmanager, and create Grafana dashboards. The Cloud Native Computing Foundation now supports Prometheus, a community project that was first created at Soundcloud.

Architecture 98

Architecture Metadata Utilities Data Collection 98

Data Engineering Podcast

MAY 13, 2021

If you want to build a warehouse that gives you both control and flexibility then you might consider building on top of the venerable PostgreSQL project. In this episode Thomas Richter and Joshua Drake share their advice on how to build a production ready data warehouse with Postgres.

PostgreSQL 100

PostgreSQL Data Warehouse Building MySQL 100

Snowflake

OCTOBER 2, 2023

To help customers overcome these challenges, RudderStack and Snowflake recently launched Profiles , a new product that allows every data team to build a customer 360 directly in their Snowflake Data Cloud environment. Now teams can leverage their existing data engineering tools and workflows to build their customer 360.

Cloud 116

Cloud Building Insurance Data Engineering 116

The Pragmatic Engineer

AUGUST 10, 2023

Ayhan visualized this data and observed a definite fall in all metrics: page views, visits, questions asked, votes. Q&A activity is definitely down: the company is aware of this metric taking a dive, and said they’re actively working to address it. When it comes to GenAI, Stack Overflow for Teams is getting a lot more love.

Retail 207

Retail Utilities Software Engineer Software Engineering 207

The Pragmatic Engineer

APRIL 19, 2023

I still remember being in a meeting where a Very Respected Engineer was explaining how they are building a project, and they said something along the lines of "and, of course, idempotency is non-negotiable." After a while, I started adopting this approach. Otherwise, understand the jargon in simple terms, yourself.

Software Engineer 343

Software Engineer Software Engineering Engineering Media 343

Knowledge Hut

APRIL 23, 2024

In the ever-evolving field of project management, staying ahead of the most recent research trends is essential for professionals who wish to enhance their skills and increase successful project outcomes. What is a Project Management Research Paper?

Project 97

Project Management Certification Utilities 97

Data Engineering Podcast

SEPTEMBER 3, 2021

In this episode Lior Gavish, Lior Solomon, and Atul Gupte share their view of what it means to have a data platform, discuss their experiences building them at various companies, and provide advice on how to treat them like a software product. Who are the stakeholders in a data platform? When is a data platform the wrong choice?

Designing 100

Designing Building SQL BI 100

Precisely

JANUARY 30, 2025

Integrate data governance and data quality practices to create a seamless user experience and build trust in your data. Beutler explains, We’re seeing more team-based governance programs starting in support of analytics or even smaller AI projects.

Data Governance 102

Data Governance Government Metadata Data 102

Knowledge Hut

MAY 31, 2023

From cutting-edge research to real-world applications, here we will investigate the most executed artificial intelligence projects. In this article, we will talk about artificial intelligence topics for the project. What are Artificial Intelligence Projects? Let us get started!

Project 96

Project Healthcare Deep Learning Transportation 96

Data Engineering Podcast

OCTOBER 2, 2021

If you need to deal with massive data, at high velocities, in milliseconds, then Aerospike is definitely worth learning about. Your host is Tobias Macey and today I’m interviewing Lenley Hensarling about Aerospike and building real-time data platforms Interview Introduction How did you get involved in the area of data management?

Building 100

Building BI Data Architecture Architecture 100

AltexSoft

MAY 12, 2022

In this article, we’ll share what we’ve learnt when creating an AI-based sound recognition solutions for healthcare projects. Now that we have a basic understanding of sound data, let’s take a glance at key stages of the end-to-end audio analysis project. Obtain project-specific audio data stored in standard file formats.

Machine Learning 122

Machine Learning Building Deep Learning Healthcare 122

Data Engineering Podcast

MARCH 10, 2024

The primary purpose of the catalog is to inform the query engine of what data exists and where, but the Nessie project aims to go beyond that simple utility. How have the design and goals of the project changed since it was first created? The link that bridges the gap between data lake and warehouse capabilities is the catalog.

Data Lake 147

Data Lake High Quality Data Architecture Machine Learning 147

Knowledge Hut

APRIL 16, 2024

Going for CSM certification training and knowing how to build a self-organizing team as a Scrum master will help you get trained well. Most Agile-Scrum organizations emphasize on building the self-organizing team - why? How Do You Build a Self-Organizing Team as a Scrum Master?

Building 98

Building Certification Project Management 98

Snowflake

FEBRUARY 13, 2023

They grow through a snowball effect, building through repeated exposure and strong ties. Successful CDOs build broad communities to foster an insights-driven culture, and scale data and analytics activities. And, there are definitely friendlies out there. Change is not spread like ideas.

Hospitality 99

Hospitality Building Banking Data 99

Towards Data Science

MARCH 9, 2023

Filling the missing values, one hot encoding for the categorical features, standardization and scaling for the numeric ones, feature extraction, and model fitting are just some of the stages that take part during a machine learning project before making any predictions.

Machine Learning 98

Machine Learning Building Datasets Big Data 98

Data Engineering Podcast

FEBRUARY 19, 2023

Projects like Apache Iceberg provide a viable alternative in the form of data lakehouses that provide the scalability and flexibility of data lakes, combined with the ease of use and performance of data warehouses. It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. We feel your pain.

IT 147

IT Data Lake Metadata Data Warehouse 147

Engineering at Meta

MAY 5, 2025

Type-checkers validate these annotations, helping prevent bugs and improving IDE functions like autocomplete and jump-to-definition. Free-threaded Python (FTP) is an experimental build of CPython that allows multiple threads to interact with the VM in parallel. What is free-threaded Python ?

Python 65

Python Coding Programming Project 65

Cloudera

MAY 1, 2023

Businesses everywhere have engaged in modernization projects with the goal of making their data and application infrastructure more nimble and dynamic. and in the Community Edition ), we have redesigned the workflow from the ground up, organizing all resources into Projects. What is a Project in SSB?

SQL 79

SQL Project Kafka Accessibility 79

Data Engineering Podcast

SEPTEMBER 11, 2022

In this episode he shares the design of the project and how it fits into your development practices. Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale. Can you describe what Schemata is and the story behind it?

Systems 100

Systems Metadata Building MongoDB 100