Data Engineering Podcast

JULY 24, 2022

Your host is Tobias Macey and today I’m interviewing Joe Reis and Matt Housley about their new book on the Fundamentals of Data Engineering Interview Introduction How did you get involved in the area of data management? Can you explain what possessed you to write such an ambitious book? What are your goals with this book?

Data Engineering 100

Data Engineering Data Engineer Lambda Architecture Engineering 100

Knowledge Hut

NOVEMBER 7, 2023

With that in mind, having the best CSM books to help you with Scrum preparation would go a long way in assisting you to become the expert you desire to be. Along with the best Scrum book, it is a plus point to go for CSM online training and boost your learning. Who is a CSM?

Certification 98

Certification Project Management Software Engineer 98

Snowflake

NOVEMBER 19, 2024

A critical part of this decision is determining which foundational technology to build infrastructure on. Will it be easy to use for my entire team? What will costs look like? How will my data stay secure and governed? I see these factors as key reasons why organizations of all sizes and industries make the move to Snowflake.

Data Governance 98

Data Governance Government Healthcare Management 98

Cloudera

SEPTEMBER 20, 2022

This blog is intended to serve as an ethics sheet for the task of AI-assisted comic book art generation, inspired by “ Ethics Sheets for AI Tasks.” AI-assisted comic book art generation is a task I proposed in a blog post I authored on behalf of my employer, Cloudera. Introduction. Scope, motivation, and benefits.

Deep Learning 88

Deep Learning High Quality Data Telecommunication Systems 88

The Pragmatic Engineer

SEPTEMBER 22, 2023

The innovator’s dilemma comes from the book of the same title by Clayton Christerenses. Technological innovation rarely happens in a vacuum; it builds on previous technologies. Bun showcases how the ‘innovator’s dilemma’ manifests in a tech ecosystem.

Programming Language 305

Programming Language Project Coding Engineering 305

Data Engineering Podcast

DECEMBER 25, 2022

Recognizing this shortcoming and the capabilities that could be unlocked by a robust solution Rishabh Poddar helped to create Opaque Systems as an outgrowth of his PhD studies. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Can you describe what you are building at Opaque Systems and the story behind it?

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Knowledge Hut

JULY 7, 2023

Sun Microsystems, the original makers of Java which Oracle later acquired, have kept pace with the advancement in the field of technology and the developers' needs to release new versions and introduce new features. However, some believe some emerging technologies might replace Java in the future.

Java 97

Java Technology Programming Language Scala 97

Data Engineering Podcast

JULY 6, 2020

Summary There are an increasing number of use cases for real time data, and the systems to power them are becoming more mature. If you hand a book to a new data engineer, what wisdom would you add to it? Many different systems provide a SQL interface to streaming data on various substrates. That’s what the Lenses.io

Systems 100

Systems Kafka SQL Data Engineering 100

Confluent

AUGUST 20, 2019

Traditional relational database systems are ubiquitous in software systems. Martin Kleppmann argues in his book Designing Data-Intensive Applications that consistency is an application-specific notion. The database system guarantees that multiple concurrent transactions will appear to the user to be executed one after the other.

Kafka 22

Kafka Systems Building Relational Database 22

The Pragmatic Engineer

APRIL 19, 2023

An example of this was how, when I was writing a book on resumes, I came across the concept of "ATSes rejecting resumes." I was sceptical that any system would automatically reject resumes, because I never saw this as a hiring manager. Look for sources, and question where the details come from.

Software Engineering 335

Software Engineering Software Engineer Engineering Media 335

Data Engineering Podcast

JULY 20, 2020

Summary Wind energy is an important component of an ecologically friendly power system, but there are a number of variables that can affect the overall efficiency of the turbines. Michael Tegtmeier founded Turbit Systems to help operators of wind farms identify and correct problems that contribute to suboptimal power outputs.

Systems 100

Systems Machine Learning Manufacturing Algorithm 100

Knowledge Hut

MAY 6, 2024

Applying systems thinking views a system as a set of interconnected and interdependent components defined by its limits and more than the sum of their parts (subsystems). When one component of a system is altered, the effects frequently spread across the entire system. are the main objectives of systems thinking.

Systems 98

Systems Transportation Certification Healthcare 98

Data Engineering Podcast

JULY 27, 2020

Summary A majority of the scalable data processing platforms that we rely on are built as distributed systems. Kyle Kingsbury created the Jepsen framework for testing the guarantees of distributed data processing systems and identifying when and why they break. This brings with it a vast number of subtle ways that errors can creep in.

Systems 100

Systems Building Scala Java 100

Data Engineering Podcast

JULY 16, 2023

Bob Muglia has had a front-row seat to many of the major shifts driven by technology over his career. In his recent book "Datapreneurs" he reflects on the people and businesses that he has known and worked with and how they relied on data to deliver valuable services and drive meaningful change.

SQL 130

SQL Machine Learning Python Data Engineering 130

Cloudera

FEBRUARY 4, 2021

I am pleased to announce that Cloudera was just named the Risk Data Repository and Data Management Product of the Year in the Risk Markets Technology Awards 2021. . There are modifications needed to systems, processes and operations. . They need a comprehensive data and analytics platform to model risk exposures on-demand.

Technology 88

Technology Data Management Management Insurance 88

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. What are some of the ways that your work on the data mesh book influenced your thinking on the practical elements of implementing a data mesh?

BI 130

BI Data Warehouse Data Engineering Data Engineer 130

Precisely

SEPTEMBER 4, 2024

While this number has grown over the years, it still indicates that technology is a male-dominated industry. As a result, the Precisely Women in Technology (PWIT) network was developed. Each month, a woman from the network is featured to share more about her experience navigating the technology industry.

Technology 63

Technology Food Computer Science Programming 63

The Pragmatic Engineer

JUNE 13, 2023

Agoda is a leading online travel booking platform in Asia. It’s owned by Booking Holdings Inc, which also owns the popular travel sites, Kayak and Booking.com. Even if you run on-prem, ensure you use technology you can shift to the cloud relatively easily. Be conservative about adding new technology dependencies.

Cloud 242

Cloud Database Utilities BI 242

Data Engineering Podcast

APRIL 14, 2024

Contact Info Blog LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Contact Info Blog LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Data Engineering Podcast

FEBRUARY 26, 2023

What are the technical systems that you are relying on to power the different data domains? What is your philosophy on enforcing uniformity in technical systems vs. relying on interface definitions as the unit of consistency? What are the technical systems that you are relying on to power the different data domains?

Building 147

Building Machine Learning Metadata Data Integration 147

Sync Computing

NOVEMBER 20, 2024

We’re thrilled to announce that Sync has partnered with Apex Systems, a leading global technology services provider with a presence in more than 70 markets across North America, Europe, and India. Combining Apex Systems industry experience with our cutting-edge tech will drive innovation that will propel the industry forward.

Systems 52

Systems Consulting Machine Learning Data Pipeline 52

François Nguyen

MARCH 7, 2021

” with 3 articles : this one about Data domains and Team Topologies, a second one devoted to the architecture and the technology and the last one about change management and the needed skills. Even without any technology, at the end, people will use Excel or any other solution to fulfill their needs. In fact, it is a problem too.

Government 130

Government Data Governance Data Metadata 130

Knowledge Hut

JANUARY 19, 2024

Cloud is a niche in technology in which security is the prime factor. This technology’s perks have made it essential for organizations to switch to cloud networks and improve performance. These people begin by completing the coursework in the CISA books and then take the exam to get certified. Learn Why Employers Hire CISAs?

Certification 52

Certification Cloud Government Programming 52

Team Data Science

DECEMBER 17, 2020

Structured Query Language (SQL) SQL has been in existence for some time now, and database systems are still prevalent and important in many companies. Companies using these technologies will also allow their data science departments to use their cloud technology to build their projects. See you later.

Data Engineering 130

Data Engineering Data Engineer Engineering Cloud Computing 130

Knowledge Hut

OCTOBER 29, 2023

With technological advancements and the need for computing services accelerating heights, many businesses are actively incorporating the cloud for better business operations. Cloud-enabled attendance system We can use a cloud-enabled automatic attendance system to scan details. The entire system is powered by electricity.

Cloud Computing 98

Cloud Computing Coding Cloud Project 98

Knowledge Hut

DECEMBER 26, 2023

In recent years, with the advent of technology, data has been considered to be a valuable asset in both large-scale and small-scale organizations. Budding aspirants and students are constantly looking for reliable data science s, research material, and the top data science books to kickstart their careers in this field.

Data Science 52

Data Science Programming Language Scala R (Programming) 52

Knowledge Hut

JANUARY 2, 2024

All you require, if you fit into any of these descriptions, is the ideal book to know it all. So, without any delay, let us delve into the AWS certified solutions architect professional books for you to refer to and excel in this career field. These books serve as valuable companions in your quest to master the AWS ecosystem: 1.

AWS 52

AWS Amazon Web Services Certification Architecture 52

Knowledge Hut

JANUARY 10, 2024

To help you on your certification journey, we have curated a list of the top 10 CBAP books that will fast-track your preparation and increase your chances of success. These books cover a wide range of topics, from the core concepts of business analysis to specific techniques and methodologies. What is CBAP?

Certification 52

Certification Business Analyst Consulting Manufacturing 52

RandomTrees

MARCH 10, 2025

Let’s explore predictive analytics, the ground-breaking technology that enables companies to anticipate patterns, optimize processes, and reach well-informed conclusions. Businesses may use this potent technology to make proactive decisions instead of reactive ones, which gives them a competitive edge in rapidly evolving industries.

Retail 52

Retail Data Governance Hospitality Banking 52

Data Engineering Podcast

DECEMBER 21, 2020

The team at Immuta has built a platform that aims to tackle that problem in a flexible and maintainable fashion so that data teams can easily integrate authorization, data masking, and privacy enhancing technologies into their data infrastructure. If you hand a book to a new data engineer, what wisdom would you add to it?

Data Governance 130

Data Governance Government Data Lake Data 130

Ascend.io

OCTOBER 28, 2024

This technique is vital for ensuring consistency and accuracy across datasets, especially in organizations that rely on multiple data systems. With its capabilities, users can efficiently extract data from various databases, reconcile differences in formats, and load the integrated data into a data warehouse or other target systems.

Raw Data 52

Raw Data Datasets Aggregated Data Data Pipeline 52

Data Engineering Podcast

AUGUST 3, 2020

If you hand a book to a new data engineer, what wisdom would you add to it? What was your motivation for writing a book to address this topic? What do you see as the driving force behind the growing popularity of graph technologies in recent years? What are some of the scaling challenges that exist for graph data engines?

NoSQL 100

NoSQL Database Algorithm Relational Database 100

Data Engineering Podcast

APRIL 17, 2022

Summary The next paradigm shift in computing is coming in the form of quantum technologies. The next frontier is in quantum networking for highly secure communications and the ability to distribute across quantum processing units without costly translation between quantum and classical systems. what limitations does it remove?)

SQL 100

SQL Data Warehouse Data Engineering Data Engineer 100

Data Engineering Podcast

JANUARY 15, 2022

Now it is being used to power consumer facing services, influence organizational behaviors, and build sophisticated machine learning systems. Can you describe what motivated you to write a book about the work of building data products? What are the main goals that you are trying to achieve through the book?

Engineering 100

Engineering Electronics Data Pipeline ETL Tools 100

Data Engineering Podcast

MARCH 10, 2024

Contact Info LinkedIn Twitter Alex's Article on Dremio's Blog Alex's Substack Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Visit dataengineeringpodcast.com/data-council and use code dataengpod20 to register today!

Data Lake 147

Data Lake High Quality Data Architecture Machine Learning 147

Knowledge Hut

DECEMBER 5, 2023

If you have a passion for information technology (IT) and dream of turning it into a fulfilling career, ponder the path of a systems engineer. Join us on a detailed exploration of who can pursue a career as a systems engineer and the steps to become one in the year 2024. Who is a System Engineer, and What Do They Do?

Systems 52

Systems Engineering Recruitment Electronics 52

Precisely

FEBRUARY 17, 2025

The Address Itself: I could write a book on this, and I recommend checking out posts from my colleagues Amy Metz and Mike Ashmore for more insights. This makes it tough for systems to recognize they’re looking at the same address. Technical Variables: Technology Constraints: Different technologies have different limitations.

Telecommunication 58

Telecommunication Utilities Business Intelligence Education 58