The Pragmatic Engineer

OCTOBER 10, 2024

Wordpress is the most popular content management system (CMS),  estimated  to power around 43% of all websites; a staggering number! We are talking about a competitor to WP Engine (Automattic) with no concrete knowledge of WP Engine’s true revenue, and demanding full access to detailed revenue reports. 25 Sep: Block.

Consulting 345

Consulting AWS Engineering Software Engineer 345

Cloudera

SEPTEMBER 20, 2022

This blog is intended to serve as an ethics sheet for the task of AI-assisted comic book art generation, inspired by “ Ethics Sheets for AI Tasks.” AI-assisted comic book art generation is a task I proposed in a blog post I authored on behalf of my employer, Cloudera. Introduction. Scope, motivation, and benefits.

Deep Learning 88

Deep Learning High Quality Data Telecommunication Systems 88

Monte Carlo

NOVEMBER 12, 2024

Uber stores its data in a combination of Hadoop and Cassandra for high availability and low latency access. Every time you play, skip, or save a song, Spotify notes the behavior and passes it to their recommendation system through Kafka. Flink then gets to work finding the nearest available driver and calculating your fare.

Architecture 96

Architecture Data Engineer Data Engineering Engineering 96

Data Engineering Podcast

JULY 27, 2020

Summary A majority of the scalable data processing platforms that we rely on are built as distributed systems. Kyle Kingsbury created the Jepsen framework for testing the guarantees of distributed data processing systems and identifying when and why they break. This brings with it a vast number of subtle ways that errors can creep in.

Systems 100

Systems Building Scala Java 100

Lyft Engineering

APRIL 3, 2023

This blog post focuses on the scope and the goals of the recommendation system, and explores some of the most recent changes the Rider team has made to better serve Lyft’s riders. Introduction: Scope of the Recommendation System The recommendation system covers user experiences throughout the ride journey.

Systems 90

Systems Pipeline-centric Machine Learning Transportation 90

Data Engineering Podcast

JULY 20, 2020

Summary Wind energy is an important component of an ecologically friendly power system, but there are a number of variables that can affect the overall efficiency of the turbines. Michael Tegtmeier founded Turbit Systems to help operators of wind farms identify and correct problems that contribute to suboptimal power outputs.

Systems 100

Systems Machine Learning Manufacturing Algorithm 100

Towards Data Science

FEBRUARY 19, 2024

Image from Unsplash Building a Semantic Book Search: Scale an Embedding Pipeline with Apache Spark and AWS EMR Serverless Using OpenAI’s Clip model to support natural language search on a collection of 70k book covers In a previous post I did a little PoC to see if I could use OpenAI’s Clip model to build a semantic book search.

AWS 90

AWS Building Python Bytes 90

Data Engineering Weekly

FEBRUARY 9, 2025

link] Pinterest: Advancements in Embedding-Based Retrieval at Pinterest Homefeed Pinterest writes about its embedding-based retrieval system enhancements for Homefeed personalization and engagement. Airbnb restricted the range of booking probabilities for map pins, which led to significant booking improvements.

Data Engineer 57

Data Engineer Data Engineering Engineering Unstructured Data 57

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. What are some of the ways that your work on the data mesh book influenced your thinking on the practical elements of implementing a data mesh?

BI 130

BI Data Warehouse Data Engineer Data Engineering 130

Data Engineering Weekly

MARCH 23, 2025

The author emphasizes the importance of mastering state management, understanding "local first" data processing (prioritizing single-node solutions before distributed systems), and leveraging an asset graph approach for data pipelines. I honestly don’t have a solid answer, but this blog is an excellent overview of upskilling.

Data Engineer 62

Data Engineer Data Engineering Engineering Data 62

Monte Carlo

APRIL 8, 2025

In practical terms, this means creating a system where everyone in your organization understands what data they’re handling and how to treat it appropriately, with safeguards if someone accidentally tries to mishandle sensitive information. And most importantlywho really needs access to this data? Want even tighter security?

PostgreSQL 52

PostgreSQL Medical Database Data 52

The Pragmatic Engineer

JUNE 13, 2023

Agoda is a leading online travel booking platform in Asia. It’s owned by Booking Holdings Inc, which also owns the popular travel sites, Kayak and Booking.com. The CDN manages caching and path optimization from the customer to Agoda, mitigating some common local access problems of remote locations.

Cloud 242

Cloud Database Utilities BI 242

AltexSoft

JULY 27, 2021

You’ll learn about the types of recommender systems, their differences, strengths, weaknesses, and real-life examples. Personalization and recommender systems in a nutshell. Primarily developed to help users deal with a large range of choices they encounter, recommender systems come into play. Amazon, Booking.com) and.

Machine Learning 76

Machine Learning Systems Algorithm Deep Learning 76

Data Engineering Podcast

APRIL 14, 2024

KNN == K-Nearest Neighbors RocksDB C# Language ASP.NET QUIC Dynamo Paper Database Internals book (affiliate link) Designing Data Intensive Applications book (affiliate link) The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA Sponsored By: Starburst : ![Starburst

Non-relational Database 147

Non-relational Database Relational Database Database Designing 147

Knowledge Hut

OCTOBER 29, 2023

Cloud-enabled attendance system We can use a cloud-enabled automatic attendance system to scan details. Administrators must register new students/employees on the system and provide some personal information. The entire system is powered by electricity. This system will also contain patient and contact information.

Cloud Computing 98

Cloud Computing Coding Cloud Project 98

Knowledge Hut

DECEMBER 26, 2023

Budding aspirants and students are constantly looking for reliable data science s, research material, and the top data science books to kickstart their careers in this field. Be it as a beginner or an experienced learner; you need to know which book is a reliable source of knowledge and is suited to your personal level of understanding.

Data Science 52

Data Science Programming Language Scala R (Programming) 52

Data Engineering Podcast

DECEMBER 21, 2020

One of the more complex aspects is that of access control to the data assets that an organization is responsible for managing. If you hand a book to a new data engineer, what wisdom would you add to it? How have the design and goals of the system evolved since you first started building it? BigQuery, Snowflake, RedShift, etc.)?

Data Governance 130

Data Governance Government Data Lake Data 130

Knowledge Hut

JANUARY 2, 2024

All you require, if you fit into any of these descriptions, is the ideal book to know it all. So, without any delay, let us delve into the AWS certified solutions architect professional books for you to refer to and excel in this career field. These books serve as valuable companions in your quest to master the AWS ecosystem: 1.

AWS 52

AWS Amazon Web Services Certification Architecture 52

Monte Carlo

NOVEMBER 21, 2024

For over 20 years, Skyscanner has been helping travelers plan and book trips with confidence— including airfare, hotels, and car rentals. And for years, this enormous amount of data was managed in an enormously complex system. As digital natives, the organization is no stranger to staggering volume.

Government 52

Government Datasets Data Governance Data 52

Monte Carlo

NOVEMBER 21, 2024

For over 20 years, Skyscanner has been helping travelers plan and book trips with confidence— including airfare, hotels, and car rentals. And for years, this enormous amount of data was managed in an enormously complex system. As digital natives, the organization is no stranger to staggering volume.

Government 52

Government Datasets Data Governance Data 52

François Nguyen

MARCH 7, 2021

When you have this vision, how to make it become a reality : the only answer to that is building a team (probably more than one) and to be more specific like a stream aligned team as defined by Matthew Skelton and Manual Pais in this book. In this previous article , you have all the basics to have for a « Data Platform As A service ».

Government 130

Government Data Governance Data Metadata 130

Knowledge Hut

OCTOBER 8, 2023

One of the various options for studying for the ECBA certification test is to use ECBA books or ECBA prep books. The oldest and the most traditional method of preparing for the ECBA test is actually reading an ECBA book. In this article I have highlighted the best ECBA books for you to read and prepare well for the exam.

Business Analyst 52

Business Analyst Certification Business Intelligence Designing 52

Monte Carlo

AUGUST 31, 2023

As the data analyst or engineer responsible for managing this data and making it usable, accessible, and trustworthy, rarely a day goes by without having to field some request from your stakeholders. In Chapter 1, we’ll start by defining what data quality means in the context of this book. But what happens when the data is wrong?

Data Lake 52

Data Lake Data Pipeline Unstructured Data Data Warehouse 52

Scott Logic

NOVEMBER 6, 2023

Embedded Accessibility is a vision of building accessible products by default. We can consider accessibility embedded when it no longer needs to be prioritised because it is already at the core of the delivery process. Our products will also be more accessible by default. Does this sound familiar?

Accessibility 59

Accessibility Accessible Coding Project 59

Towards Data Science

MAY 11, 2023

Sharvit deconstructs the elements of complexity that sometimes seems inevitable with OOP and summarizes the main principles of DOP that helps us make the system more manageable. In Python, data held by a class can still be accessed by any piece of code that has a reference to the object.

Programming 98

Programming Python Data Schemas Java 98

Knowledge Hut

SEPTEMBER 24, 2024

Study Guides and Books: There are several study guides and books available that provide detailed explanations, examples, and practice questions for PRINCE2 certification. The ATO will book the exam on behalf of the candidate, print the question papers and OMR answer sheets and invigilate the exam.

Certification 98

Certification Project Government Management 98

Precisely

FEBRUARY 17, 2025

The Address Itself: I could write a book on this, and I recommend checking out posts from my colleagues Amy Metz and Mike Ashmore for more insights. This makes it tough for systems to recognize they’re looking at the same address. It’s amazing how creative people can be with something so seemingly straightforward.

Telecommunication 58

Telecommunication Utilities Business Intelligence Education 58

Knowledge Hut

OCTOBER 11, 2023

There are many books on the market where you can learn and understand Power BI. This post will discuss the Top 10 Power BI books for beginners and advanced-level readers. From understanding the basics to mastering advanced techniques, these books are your gateway to harnessing the full potential of Power BI.

BI 52

BI Business Intelligence Data Analysis Data Preparation 52

Knowledge Hut

DECEMBER 22, 2023

Classes are mandatory as the course provides access to all the study materials and the exam.  The exam format is a web-based, closed book multiple choice timed exam. One-year membership to the SAFe® Community Platform, which includes access to the SA Community of Practice. the most popular type of Agile.

Certification 98

Certification Portfolio Education Programming 98

The Modern Data Company

FEBRUARY 14, 2023

After a winter storm blew through a large swath of the United States, Southwest’s systems and processes had a complete meltdown. While the weather certainly was a catalyst for the mess, it is widely understood that a high level of technical debt within Southwest’s operational systems made a bad situation much, much worse.

Government 105

Government Systems Accessibility Accessible 105

Striim

JULY 30, 2024

Ensuring system resilience is critical for maintaining a competitive edge in today’s data-driven world. As businesses rely on real-time data to fuel decision-making, it’s essential that their systems can withstand disruptions and maintain functionality.

Systems 52

Systems Healthcare Utilities Data Integration 52

Data Engineering Podcast

OCTOBER 26, 2020

If you are putting your workflows into production, then you need to consider how you are going to implement data security, including access controls and auditing. Different databases and storage systems all have their own method of restricting access, and they are not all compatible with each other.

Data Security 100

Data Security Coding Cloud MongoDB 100

Knowledge Hut

JANUARY 11, 2024

AWS offers over 160 patented services and other additional courses through the Marketplace that can be accessed by people from all across the world. CloudPractitioner Certification is accessible to anyone who is interested in a career in technology and IT. Online practice tests are widely accessible. What is A mazon Web Service?

AWS 96

AWS Amazon Web Services Cloud Cloud Computing 96

Data Engineering Podcast

AUGUST 6, 2021

The trouble is that the data is usually spread across a wide and shifting array of systems, from databases to dashboards. Now there’s a book that captures the foundational lessons and principles that underly everything that you hear about here. The data you’re looking for is already in your data warehouse and BI tools.

Database 100

Database SQL BI Business Intelligence 100

Knowledge Hut

OCTOBER 27, 2023

System design projects involve creating a plan for a complex system that will meet specific requirements or solve a particular problem. These projects may involve designing software applications, network infrastructures, manufacturing processes, or other complex systems. What is System Design?

Designing 52

Designing Systems Project Cloud Computing 52

Knowledge Hut

OCTOBER 27, 2023

destroyAllWindows() By engaging in this Gesture Language Translator project, you'll not only enhance your programming skills but also contribute to fostering a more inclusive and accessible world. Student Portal: Students can enroll in courses, access course materials, and communicate with instructors and other students.

Software Engineer 98

Software Engineer Software Engineering Coding Project 98

Data Engineering Podcast

MARCH 10, 2024

Trusted by the teams at Comcast and Doordash, Starburst delivers the adaptability and flexibility a lakehouse ecosystem promises, while providing a single point of access for your data and all your data governance allowing you to discover, transform, govern, and secure all in one place.

Data Lake 147

Data Lake High Quality Data Architecture Machine Learning 147