Learning System Design: Top 5 Essential Reads
KDnuggets
MAY 23, 2024
Explore system design with these expert-recommended books.
Design effective & reliable machine learning systems!
KDnuggets
MAY 18, 2023
Machine Learning System Design: With end-to-end examples is a practical guide for planning and designing successful ML applications. It lays out a clear, repeatable framework for building, maintaining, and improving systems at any scale.
Machine Learning 
111
111 Join 16,000+
Insiders
Sign Up for our Newsletter
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Webinars
Launching LLM-Based Products: From Concept to Cash in 90 Days
How To Speak The Language Of Financial Success In Product Management
The AI Superhero Approach to Product Management
Driving Responsible Innovation: How to Navigate AI Governance & Data Privacy
Trending Sources
Learn How to Design & Deploy Responsible AI Systems
KDnuggets
NOVEMBER 8, 2023
Learn how to design & deploy responsible AI systems with this white paper from Teradata.
Designing 136
136 
Learn How to Design & Deploy Responsible AI Systems
KDnuggets
OCTOBER 4, 2023
Learn how to design & deploy responsible AI systems with this white paper from Teradata.
Designing 133
133 
Leading the Development of Profitable and Sustainable Products
Speaker: Jason Tanner
A sustainable business model contains a system of interrelated choices made not once but over time. Discover how to design and evolve profit streams over time, focusing on solution sustainability, economic sustainability, and relationship sustainability.
5 Database Schema Design Example: Critical Practices & Designs
Hevo
DECEMBER 26, 2023
As a result, organizations should focus on designing superior databases to meet the objectives of projects without losing direction. Consequently, Database Schema Design Examples and the Database Schema Example have […] Databases are the cornerstone of almost all business projects.
Designing 98
98 
A Developer’s Guide to Payment Engine System Design
Ripple Engineering
JUNE 20, 2023
The RippleX engineering team has published a new whitepaper that provides an overview of the Payment Engine (PE) system, including design concepts and examples. The full whitepaper demonstrates key concepts of the PE system with several examples.
Designing 52
52 
Design Considerations for Cloud-Native Data Systems
Confluent
JULY 26, 2021
Since then, growth and innovation has shifted to the cloud, and a new generation of data systems have […]. Twenty years ago, the data warehouses of choice were Oracle and Teradata.
Systems 111
111 
Designing a "low-effort" ELT system, using stitch and dbt
Start Data Engineering
JULY 11, 2020
Intro A very common use case in data engineering is to build a ETL system for a data warehouse, to have data loaded in from multiple separate databases to enable data analysts/scientists to be able to run queries on this data, since the source databases are used by your applications and we do not want these analytic queries to affect our application (..)
Systems 130
130 
LLMs in Production: Tooling, Process, and Team Structure
Speaker: Dr. Greg Loughnane and Chris Alexiuk
However, during development – and even more so once deployed to production – best practices for operating and improving generative AI applications are less understood.
Design Patterns for Machine Learning Pipelines
KDnuggets
NOVEMBER 2, 2021
ML pipeline design has undergone several evolutions in the past decade with advances in memory and processor performance, storage systems, and the increasing scale of data sets. We describe how these design patterns changed, what processes they went through, and their future direction.
Machine Learning 160
160 
Supporting Diverse ML Systems at Netflix
Netflix Tech
MARCH 7, 2024
The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems. ETL workflows), as well as downstream (e.g.
Systems 91
91 
Redesigning Pinterest’s Ad Serving Systems with Zero Downtime (part 2)
Pinterest Engineering
AUGUST 20, 2024
Director, Engineering | In the first part of the post, we introduced the motivations on why we decided to rewrite the ads serving systems and the desired final state. We also outlined our design principles and high level design decisions on how to get there. One example is as follows in Table 1.
Systems 54
54 
How to design a dbt model from scratch
Towards Data Science
JULY 10, 2023
I mean how do you know the right design? This underscores the importance of thinking carefully about how we design models, not just on our own in dbt, but collectively with all of our stakeholders, to make sure the model is accurate and effective , and we don’t waste our time building each model 4–5 times before its useful.
Designing 98
98 
Movie Recommendation System: Definition, Strategies, Usecase
Knowledge Hut
FEBRUARY 1, 2024
Not only could this recommendation system save time browsing through lists of movies, it can also give more personalized results so users don’t feel overwhelmed by too many options. What are Movie Recommendation Systems? Recommender systems have two main categories: content-based & collaborative filtering.
Systems 98
98 
Introducing Cloudera DataFlow Designer: Self-service, No-Code Dataflow Design
Cloudera
DECEMBER 9, 2022
These are the questions we asked ourselves, and I am excited to announce the technical preview of DataFlow Designer, making self-service dataflow development a reality for Cloudera customers. Figure 1: The Designer canvas with a brand new look and feel. directly in the designer makes building new flows a lot more self-service.
Designing 101
101 
Designing and testing for accessibility in GIS and mapping
ArcGIS
MAY 13, 2024
Review best practices for designing and testing for accessibility maps and apps throughout the ArcGIS system during the development process.
Accessible 92
92 
Fail Safe vs Fail Secure: Top Differences in Locking Systems
Knowledge Hut
MARCH 22, 2024
I have comprehensively analyzed the area of physical security, particularly the ongoing discussion surrounding fail safe vs fail-safe secure electric strike locking systems. On the other hand, fail-secure systems focus on maintaining continuous security, keeping doors locked even in difficult conditions to protect assets.
Systems 105
105 
How Systems Thinking Can Be Applied To Agile Transformations
Knowledge Hut
MAY 6, 2024
Applying systems thinking views a system as a set of interconnected and interdependent components defined by its limits and more than the sum of their parts (subsystems). When one component of a system is altered, the effects frequently spread across the entire system. are the main objectives of systems thinking.
Systems 98
98 
NEP: Notification System and Relevance
Pinterest Engineering
AUGUST 8, 2024
In our previous system, which operated on a daily budget allocation model, the system relied on predicting daily budgets for individual users on a daily basis, constraining the flexibility and responsiveness required for dynamic user engagement and content changes. Figure 1 below shows the overview of the system architecture.
Systems 42
42 
Designing and testing for accessibility in GIS and mapping
ArcGIS
MAY 13, 2024
Review best practices for designing and testing for accessibility maps and apps throughout the ArcGIS system during the development process.
Accessible 79
79 
Redesigning Pinterest’s Ad Serving Systems with Zero Downtime
Pinterest Engineering
JUNE 7, 2024
Director, Engineering | Introduction The ads-serving platform is the highest-scale recommendation system at Pinterest, responsible for delivering >$3B in yearly revenue and making it one of the most business critical systems at the company! Mohawk, implemented in 2014, was Pinterest’s first ad serving system.
Systems 60
60 
A Tour Around Buck2, Meta's New Build System
Tweag
JULY 5, 2023
Buck2 is a from-scratch rewrite of Buck , a polyglot, monorepo build system that was developed and used at Meta (Facebook), and shares a few similarities with Bazel. As you may know, the Scalable Builds Group at Tweag has a strong interest in such scalable build systems. Meta recently announced they have made Buck2 open-source.
Systems 141
141 
The Recommendation System at Lyft
Lyft Engineering
APRIL 3, 2023
This blog post focuses on the scope and the goals of the recommendation system, and explores some of the most recent changes the Rider team has made to better serve Lyft’s riders. Introduction: Scope of the Recommendation System The recommendation system covers user experiences throughout the ride journey.
Systems 87
87 
What is a System Engineer? Skills, Roles and Responsibilities
Knowledge Hut
JUNE 9, 2024
Systems engineering is a diverse field of information technology engineering and engineering management that focuses on the design and administration of composite systems throughout their life cycles. Let's explore what is system engineer? What is a System Engineer?
Systems 52
52 
How to Design a Modern, Robust Data Ingestion Architecture
Monte Carlo
MAY 28, 2024
Let’s see what it takes to design an ingestion architecture that ensures reliable, real-time data processing and supports effective decision-making in big data environments. Data Loading : Load transformed data into the target system, such as a data warehouse or data lake.
Why Legacy CCM Systems Are Costing You Customers and Employees
Precisely
AUGUST 12, 2024
Key Takeaways Legacy CCM systems are damaging to customer satisfaction and employee productivity and are no longer sustainable. But many organizations continue using outdated legacy CCM systems, which can significantly hinder both customer satisfaction and employee productivity and retention.
Systems 52
52 
An Overview of Kanban System Examples
Knowledge Hut
MAY 17, 2024
In the early 1940s, Toyota automotive in Japan used a simple planning system to manage and control work and inventory at each stage optimally. It is related to lean and just-in-time JIT production, where it is used as a scheduling system to indicate what to produce, when, and how much. How does Kanban System work?
Systems 52
52 
10 Best Software Design Patterns in 2024 [Types & Benefits]
Knowledge Hut
MARCH 26, 2024
Therefore, Design Patterns in Software Design are typical solutions to such problems. Before we dig deep into What are Software Design Patterns? This book featured 23 patterns in design patterns which were used to solve problems related to object-oriented design. What is a Software Design Pattern?
Designing 52
52 
Understanding The Immune System With Data At ImmunAI
Data Engineering Podcast
FEBRUARY 20, 2022
He also explains how he has architected the systems that ingest, process, and distribute the data that he is responsible for and the requirements that are introduced when collaborating with researchers, domain experts, and machine learning developers. that you need to account for in the design? How does it work? How does it work?
Systems 100
100 
ITIL Service Design: Principles, Process and Its Importance
Knowledge Hut
JANUARY 31, 2024
It can be difficult to design IT services that meet business needs and customer expectations. The service design module is one of the certifications within ITIL v3 Service Lifecycle workstream. ITIL service design provides a holistic design approach to aid companies deliver better services. What is ITIL Service Design?
Designing 52
52 
Business System Analyst Job Description [2023 Updated]
Knowledge Hut
DECEMBER 27, 2023
The job of a business systems analyst is a uniquely cross-functional one that plays a critical role in improving a company’s processes for better operational efficiency. What is Business Systems Analyst? Business systems analyst duties also include writing instruction manuals and analyzing costs and benefits related to technology.
Systems 52
52 
12 Important UI Design Principles to Know in 2024
Knowledge Hut
MARCH 21, 2024
Most people don't pay much attention to an app's or software's UI design until something goes wrong. Because of this, we might argue that effective user interface design is essentially invisible, allowing users to work uninterrupted. Want to enhance your knowledge in UI design or pick up new skills?
Designing 52
52 
12 Important UX Design Principles to Know in 2024
Knowledge Hut
MARCH 28, 2024
You all must be aware of the fact that user experience (UX) is the cornerstone of successful design. In this blog, we’ll simply make it easier for you to understand the core ideas that influence UX design. Come, let’s explore these 12 UI/UX design concepts and equip you to produce long-lasting designs.
Designing 52
52 
The Ultimate Guide to becoming Business Systems Analyst
Knowledge Hut
FEBRUARY 15, 2024
Business systems analysts are professionals who work with a company's internal IT department to ensure that its computer systems are running smoothly. If you're interested in becoming a business systems analyst, read our ultimate guide on what a business systems analyst does! Who is a Business Systems Analyst?
Systems 52
52 
System Engineer Salary Guide 2024
Knowledge Hut
DECEMBER 26, 2023
Systems engineering is an interdisciplinary technology and systematic engineering methodology focusing on designing, developing, and managing complex systems over their entire life cycle. Systems engineering works on such projects utilizing work procedures, optimization methodologies, and tools for risk management.
Systems 52
52 
What is a Business Systems Analyst and How to Become?
Edureka
AUGUST 27, 2024
It was concluded that the position of a Business Systems Analyst (BSA) is vital in transitioning from business requirements to solutions. Who is a Business Systems Analyst? This will enable an organization to adjust its systems and procedures. What Does a Business Systems Analyst Do?
Systems 40
40 
Intrusion Detection System (IDS): Types, Techniques, and Applications
Knowledge Hut
APRIL 25, 2024
Intrusion detection systems (IDS) are designed to identify suspicious and malicious activity through network traffic. So, let's get to know the meaning of an intrusion detection system and how it works. What Is a n Intrusion Detection System? Why Are Intrusion Detection Systems Important? and how it works.
Systems 52
52 
Designing For Data Protection
Data Engineering Podcast
NOVEMBER 11, 2019
Summary The practice of data management is one that requires technical acumen, but there are also many policy and regulatory issues that inform and influence the design of our systems. How can we ensure effective deletion of these records when dealing with multiple storage systems?
Designing 100
100 
What Is Ethical Design? Importance, Principles & How to Use
Knowledge Hut
MARCH 29, 2024
In this rapidly growing digital world, I've realized that ethical considerations in design frameworks have never been more critical than before. As a designer, I exert significant influence over how people interact with technology and data, making the imperative for ethical design important to me. What is Ethical Design?
Designing 52
52 
15 Best Wireframing Tools for UI/UX Designers in 2024
Knowledge Hut
MARCH 27, 2024
Wireframing might take a lot of time, but wireframe tools can help by providing helpful features that let designers work more quickly. Feedback: Wireframes serve as a communication tool, allowing stakeholders to provide feedback and make revisions early in the design process. Pros: Intuitive interface for designing and prototyping.
Designing 52
52 
UI vs UX Design: What’s the Difference?
Knowledge Hut
JANUARY 3, 2024
We are experiencing a beautiful period of designing, with new techniques and fads appearing and fading. With more developers interested in UI/UX design, front-end programming is also gaining traction. In contrast, UI often interacts with customers' interaction with computer systems, programs, and apps. Only digital products.
Designing 52
52 
UX Designer Job Description For 2024 [with Template]
Knowledge Hut
DECEMBER 22, 2023
The importance of the UX Designer in creating outstanding user-centric products and services has increased as the digital landscape continues to change quickly. UX Designer Job Description: Overview The User experience designer job description entails various responsibilities geared toward developing exceptional user experiences.
Designing 52
52 
System Administrator Salary in 2024 [Fresher to Experienced]
Knowledge Hut
MARCH 28, 2024
The modern tech-driven landscape is ideal for System Administrators. As computers continue to permeate every aspect of the economy, the need for skilled System Administrators is expected to grow exponentially. Who Is a System Administrator?
Systems 52
52 
Let's personalize your content