Data Engineering Podcast

JULY 24, 2022

Your host is Tobias Macey and today I’m interviewing Joe Reis and Matt Housley about their new book on the Fundamentals of Data Engineering Interview Introduction How did you get involved in the area of data management? Can you explain what possessed you to write such an ambitious book? What are your goals with this book?

Data Engineering 100

Data Engineering Data Engineer Lambda Architecture Engineering 100

Cloudera

SEPTEMBER 20, 2022

This blog is intended to serve as an ethics sheet for the task of AI-assisted comic book art generation, inspired by “ Ethics Sheets for AI Tasks.” AI-assisted comic book art generation is a task I proposed in a blog post I authored on behalf of my employer, Cloudera. Introduction. Scope, motivation, and benefits.

Deep Learning 94

Deep Learning High Quality Data Telecommunication Systems 94

Knowledge Hut

NOVEMBER 7, 2023

With that in mind, having the best CSM books to help you with Scrum preparation would go a long way in assisting you to become the expert you desire to be. Along with the best Scrum book, it is a plus point to go for CSM online training and boost your learning. Who is a CSM?

Certification 98

Certification Project Management Software Engineer 98

Data Engineering Podcast

DECEMBER 25, 2022

Recognizing this shortcoming and the capabilities that could be unlocked by a robust solution Rishabh Poddar helped to create Opaque Systems as an outgrowth of his PhD studies. Visit dataengineeringpodcast.com/datafold today to book a demo with Datafold. Can you describe what you are building at Opaque Systems and the story behind it?

Machine Learning 130

Machine Learning Systems Data Lake Data Warehouse 130

Knowledge Hut

MAY 6, 2024

Applying systems thinking views a system as a set of interconnected and interdependent components defined by its limits and more than the sum of their parts (subsystems). When one component of a system is altered, the effects frequently spread across the entire system. are the main objectives of systems thinking.

Systems 98

Systems Transportation Certification Healthcare 98

The Pragmatic Engineer

SEPTEMBER 19, 2024

Later this year, he’s publishing a book on tech debt. In the early 90’s, DOS programs like the ones my company made had its own Text UI screen rendering system. This rendering system was easy for me to understand, even on day one. Our rendering system was very memory inefficient, but that could be fixed.

Recruitment 176

Recruitment Java Coding Project 176

Knowledge Hut

JULY 7, 2023

Sun Microsystems, the original makers of Java which Oracle later acquired, have kept pace with the advancement in the field of technology and the developers' needs to release new versions and introduce new features. However, some believe some emerging technologies might replace Java in the future.

Java 97

Java Technology Programming Language Scala 97

Data Engineering Podcast

JULY 6, 2020

Summary There are an increasing number of use cases for real time data, and the systems to power them are becoming more mature. If you hand a book to a new data engineer, what wisdom would you add to it? Many different systems provide a SQL interface to streaming data on various substrates. That’s what the Lenses.io

Systems 100

Systems Kafka SQL Government 100

Confluent

AUGUST 20, 2019

Traditional relational database systems are ubiquitous in software systems. Martin Kleppmann argues in his book Designing Data-Intensive Applications that consistency is an application-specific notion. The database system guarantees that multiple concurrent transactions will appear to the user to be executed one after the other.

Kafka 22

Kafka Systems Building Relational Database 22

Data Engineering Podcast

JULY 20, 2020

Summary Wind energy is an important component of an ecologically friendly power system, but there are a number of variables that can affect the overall efficiency of the turbines. Michael Tegtmeier founded Turbit Systems to help operators of wind farms identify and correct problems that contribute to suboptimal power outputs.

Systems 100

Systems Machine Learning Manufacturing Algorithm 100

Data Engineering Podcast

JULY 27, 2020

Summary A majority of the scalable data processing platforms that we rely on are built as distributed systems. Kyle Kingsbury created the Jepsen framework for testing the guarantees of distributed data processing systems and identifying when and why they break. This brings with it a vast number of subtle ways that errors can creep in.

Systems 100

Systems Building Scala Java 100

The Pragmatic Engineer

SEPTEMBER 22, 2023

The innovator’s dilemma comes from the book of the same title by Clayton Christerenses. Technological innovation rarely happens in a vacuum; it builds on previous technologies. Bun showcases how the ‘innovator’s dilemma’ manifests in a tech ecosystem.

Programming Language 255

Programming Language Project Coding Engineering 255

The Pragmatic Engineer

APRIL 19, 2023

An example of this was how, when I was writing a book on resumes, I came across the concept of "ATSes rejecting resumes." I was sceptical that any system would automatically reject resumes, because I never saw this as a hiring manager. Look for sources, and question where the details come from.

Software Engineer 295

Software Engineer Software Engineering Engineering Media 295

Jesse Anderson

JUNE 7, 2022

In 2021 I had the pleasure to first get to know and speak with Zhamak Dheghani, Director of Emerging Technologies at ThoughtWorks, in season one of the Data Dream Team series. Since we spoke, Zhamak has had the time to finish her book, reflect on the impact of data mesh, and think about what’s next.

Generalist 130

Generalist Software Engineer Software Engineering Data 130

Data Engineering Podcast

JULY 16, 2023

Bob Muglia has had a front-row seat to many of the major shifts driven by technology over his career. In his recent book "Datapreneurs" he reflects on the people and businesses that he has known and worked with and how they relied on data to deliver valuable services and drive meaningful change.

SQL 130

SQL Machine Learning Python Data Engineering 130

Precisely

SEPTEMBER 4, 2024

While this number has grown over the years, it still indicates that technology is a male-dominated industry. As a result, the Precisely Women in Technology (PWIT) network was developed. Each month, a woman from the network is featured to share more about her experience navigating the technology industry.

Technology 64

Technology Food Computer Science Programming 64

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. What are some of the ways that your work on the data mesh book influenced your thinking on the practical elements of implementing a data mesh?

BI 130

BI Data Warehouse Data Engineering Data Engineer 130

Jesse Anderson

DECEMBER 12, 2022

Google looked over the expanse of the growing internet and realized they’d need scalable systems. They were the first companies to commercialize open source big data technologies and pushed the marketing and commercialization of Hadoop. We lacked a scalable pub/sub system. Some people blamed the technologies.

Data Engineering 130

Data Engineering Data Engineer Engineering Hadoop 130

Data Engineering Podcast

APRIL 14, 2024

Contact Info Blog LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Contact Info Blog LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Knowledge Hut

JANUARY 19, 2024

Cloud is a niche in technology in which security is the prime factor. This technology’s perks have made it essential for organizations to switch to cloud networks and improve performance. These people begin by completing the coursework in the CISA books and then take the exam to get certified. Learn Why Employers Hire CISAs?

Certification 52

Certification Cloud Government Programming 52

Knowledge Hut

DECEMBER 26, 2023

In recent years, with the advent of technology, data has been considered to be a valuable asset in both large-scale and small-scale organizations. Budding aspirants and students are constantly looking for reliable data science s, research material, and the top data science books to kickstart their careers in this field.

Data Science 52

Data Science Programming Language Scala R (Programming) 52

Data Engineering Podcast

FEBRUARY 26, 2023

What are the technical systems that you are relying on to power the different data domains? What is your philosophy on enforcing uniformity in technical systems vs. relying on interface definitions as the unit of consistency? What are the technical systems that you are relying on to power the different data domains?

Building 147

Building Machine Learning Metadata Data Integration 147

Knowledge Hut

JANUARY 2, 2024

All you require, if you fit into any of these descriptions, is the ideal book to know it all. So, without any delay, let us delve into the AWS certified solutions architect professional books for you to refer to and excel in this career field. These books serve as valuable companions in your quest to master the AWS ecosystem: 1.

AWS 52

AWS Amazon Web Services Certification Architecture 52

Knowledge Hut

JANUARY 10, 2024

To help you on your certification journey, we have curated a list of the top 10 CBAP books that will fast-track your preparation and increase your chances of success. These books cover a wide range of topics, from the core concepts of business analysis to specific techniques and methodologies. What is CBAP?

Certification 52

Certification Business Analyst Consulting Manufacturing 52

François Nguyen

MARCH 7, 2021

” with 3 articles : this one about Data domains and Team Topologies, a second one devoted to the architecture and the technology and the last one about change management and the needed skills. Even without any technology, at the end, people will use Excel or any other solution to fulfill their needs. In fact, it is a problem too.

Government 130

Government Data Governance Data Metadata 130

Team Data Science

DECEMBER 17, 2020

Structured Query Language (SQL) SQL has been in existence for some time now, and database systems are still prevalent and important in many companies. Companies using these technologies will also allow their data science departments to use their cloud technology to build their projects. See you later.

Data Engineering 130

Data Engineering Data Engineer Engineering Cloud Computing 130

Knowledge Hut

OCTOBER 29, 2023

Hospital Management System Type : Application development, Database management, Programming There is no shortage of computer science project topics out there. But if you are looking for something that's both technically challenging and socially relevant, consider a hospital management system. Source Code: OCR System 5.

Computer Science 111

Computer Science Coding Project Hospitality 111

Knowledge Hut

OCTOBER 29, 2023

With technological advancements and the need for computing services accelerating heights, many businesses are actively incorporating the cloud for better business operations. Cloud-enabled attendance system We can use a cloud-enabled automatic attendance system to scan details. The entire system is powered by electricity.

Cloud Computing 98

Cloud Computing Coding Cloud Project 98

Data Engineering Podcast

MARCH 10, 2024

Contact Info LinkedIn Twitter Alex's Article on Dremio's Blog Alex's Substack Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Visit dataengineeringpodcast.com/data-council and use code dataengpod20 to register today!

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

The Pragmatic Engineer

JUNE 13, 2023

Agoda is a leading online travel booking platform in Asia. It’s owned by Booking Holdings Inc, which also owns the popular travel sites, Kayak and Booking.com. Even if you run on-prem, ensure you use technology you can shift to the cloud relatively easily. Be conservative about adding new technology dependencies.

Cloud 201

Cloud Database Utilities BI 201

Knowledge Hut

JANUARY 19, 2024

Like every other field, system security also has specialized certifications that people do to prove their worth to the employer and grab the best job opportunities. The International Information System Security Certification Consortium offers some certifications to the professionals like CISSP ISSMP.

Systems 52

Systems Management Certification Programming 52

Knowledge Hut

JANUARY 11, 2024

Cloud Computing is one of the biggest industries in Information Technology. It CloudPractitioner Certification is accessible to anyone who is interested in a career in technology and IT. AWS Cloud Practitioner Certification is meant for Systems Engineers, Network Engineers, Developers, Sales, Marketing , and IT leaders. Here

AWS 96

AWS Amazon Web Services Cloud Cloud Computing 96

Knowledge Hut

MAY 20, 2024

For example, through ethical hacking, one can get the authorization of some system, but it is done to create a shield against the odds. Later, being encouraged by his followers, he wrote his first book, An Unofficial Guide to Ethical Hacking, when he was merely 14! His books have been very well received all over the world.

Consulting 98

Consulting Certification Computer Science Media 98

Knowledge Hut

NOVEMBER 19, 2023

With advances in technology, wearable devices do provide some trace of your health. I wrote an article named ‘An Introduction to Azure IoT with Machine Learning,’ in that blog, I took an example of a system that monitors temperature and humidity. Here is a flow from the book that broadly encompasses these ideas.

Data Science 52

Data Science Technology Machine Learning Big Data 52

Data Engineering Podcast

DECEMBER 21, 2020

The team at Immuta has built a platform that aims to tackle that problem in a flexible and maintainable fashion so that data teams can easily integrate authorization, data masking, and privacy enhancing technologies into their data infrastructure. If you hand a book to a new data engineer, what wisdom would you add to it?

Data Governance 130

Data Governance Government Data Lake Banking 130

Data Engineering Podcast

AUGUST 3, 2020

If you hand a book to a new data engineer, what wisdom would you add to it? What was your motivation for writing a book to address this topic? What do you see as the driving force behind the growing popularity of graph technologies in recent years? What are some of the scaling challenges that exist for graph data engines?

NoSQL 100

NoSQL Database Algorithm Relational Database 100

Christophe Blefari

SEPTEMBER 28, 2023

Big Data London exists since 2016 and when we look at sponsors it's like an history book. That's why big data technologies got swooshed by the modern data stack when it arrived on the market—excepting Spark. When you are a data engineer you're getting paid to build systems that people can rely on.

Big Data 147

Big Data Cloud Storage Hadoop SQL 147