The Pragmatic Engineer

NOVEMBER 9, 2023

In 2019, Javice was featured on the Forbes “30 under 30” finance list , suggesting she was a high-flying founder: How Charlie Javice appeared on the Forbes 30 under 30 list in 2019. Frank: a software engineer refuses to fake customer data Frank was a student loan startup founded by Charlie Javice in 2016.

Software Engineer 277

Software Engineer Software Engineering Engineering Coding 277

KDnuggets

SEPTEMBER 4, 2019

Recommender systems are an important class of machine learning algorithms that offer "relevant" suggestions to users. Categorized as either collaborative filtering or a content-based system, check out how these approaches work along with implementations to follow from example code.

Machine Learning 121

Machine Learning Systems Algorithm Coding 121

KDnuggets

AUGUST 23, 2019

Alibaba, the largest e-commerce platform in China, is a powerhouse not only when it comes to e-commerce, but also when it comes to recommender systems research. Their latest paper, Behaviour Sequence Transformer for E-commerce Recommendation in Alibaba, is yet another publication that pushes the state of the art in recommender systems.

Systems 117

Systems IT Engineering 117

The Pragmatic Engineer

APRIL 13, 2023

Source: Dealroom Seed investments have dropped since 2021, but in 2022 were around the same level as in 2020 – and well above 2019. But what about seed rounds in Europe, typically of $1-4M by check size? Seed investments in Europe. Zooming out, how have all investment rounds stacked up against previous years?

Finance 230

Finance Media Software Engineer Software Engineering 230

Confluent

SEPTEMBER 23, 2019

Kafka Summit San Francisco 2019 is located at the Hilton San Francisco Union Square. His particular interests are analytics, systems architecture, performance testing, and optimization. Know the logistics. Coming and going. Kafka Summit starts with keynote talks at 9:30 a.m. You can follow him on Twitter.

Kafka 18

Kafka Hadoop Architecture Database 18

Confluent

APRIL 16, 2019

To build the kinds of systems we are being called upon to build these days, we need infrastructure that gives equal priority to events and state together. and a couple of fantastic keynotes: Jay Kreps (CEO of Confluent and co-creator of Apache Kafka ® ) kept the unifying vision of the event streaming platform in front of us.

Kafka 102

Kafka Database Programming Systems 102

The Pragmatic Engineer

MAY 11, 2023

Datadog is a leading observability tooling provider which went public in 2019, with a current market cap of $28B. A very popular open-source solution for systems and services monitoring. A fast and open-source column-oriented database management system, which is a popular choice for log management.

AWS 339

AWS Software Engineer Software Engineering Google Cloud 339

Netflix Tech

MARCH 28, 2025

By Ko-Jen Hsiao , Yesu Feng and Sudarshan Lamkhede Motivation Netflixs personalized recommender system is a complex system, boasting a variety of specialized machine learned models each catering to distinct needs including Continue Watching and Todays Top Picks for You. Refer to our recent overview for more details).

Metadata 88

Metadata Bytes Entertainment Data Mining 88

The Pragmatic Engineer

MARCH 19, 2024

When we looked at GitHub Copilot alternatives , all were launched at least a year after GitHub Copilot’s 2021 launch except Tabnine, launched in 2019. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineer 323

Software Engineer Software Engineering Programming Language Media 323

Confluent

OCTOBER 9, 2019

How Kroger Embraced a “Schema-First” Philosophy in Building Real-Time Data Pipelines by Rob Hoeting, Rob Hammonds, and Lauren McDonald of Systems Evolution. He is the co-presenter of various O’Reilly training videos on topics ranging from Git to distributed systems, and is the author of Gradle Beyond the Basics. Photo Credit: Derek C.

Kafka 17

Kafka Software Engineer Software Engineering Data Pipeline 17

The Pragmatic Engineer

APRIL 6, 2023

For AI,  we’ve built a system to efficiently use GPT-4 for this purpose, including auto-crafting prompts and performing pre and post-processing. Our system is using purely Serverless to process the data. We use React on the frontend, Node.js on the backend, and Postgres for database storage.

Software Engineer 231

Software Engineer Software Engineering Datasets Database 231

Confluent

SEPTEMBER 30, 2019

He is the co-presenter of various O’Reilly training videos on topics ranging from Git to distributed systems, and is the author of Gradle Beyond the Basics. He can frequently be found at speaking at conferences in the U.S. and all over the world. He tweets as @tlberglund and lives in Littleton, CO, U.S.,

Kafka 17

Kafka Architecture Cloud Designing 17

Engineering at Meta

FEBRUARY 4, 2025

Here we explore initial system designs we considered, an overview of the current architecture, and some important principles Meta takes into account in making data accessible and easy to understand. 2019: Users can view their activity off Meta-technologies and clear their history. feature on Facebook. What are data logs?

Accessible 89

Accessible Accessibility Raw Data Data Warehouse 89

Confluent

JANUARY 21, 2020

Netflix spent an estimated $15 billion to produce world-class original content in 2019. When stakes are so high, it is paramount to enable our business with critical insights that help […].

Finance 27

Finance Kafka IT Systems 27

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. How has your view of the principles of the data mesh changed since our conversation in July of 2019?

BI 130

BI Data Warehouse Data Engineering Data Engineer 130

Confluent

APRIL 3, 2019

END AS DEPARTMENT, PRODUCT FROM PRODUCTS; ksql> DESCRIBE PRODUCTS_ENRICHED; Name : PRODUCTS_ENRICHED Field | Type - ROWTIME | BIGINT (system) ROWKEY | VARCHAR(STRING) (system) SKU | VARCHAR(STRING) DEPARTMENT | VARCHAR(STRING) PRODUCT | VARCHAR(STRING). WHEN SKU LIKE 'F%' THEN 'Food'. ELSE 'Unknown'. KSQL processing log.

Food 96

Food Kafka Bytes Data Cleanse 96

The Pragmatic Engineer

MAY 1, 2024

When we looked at GitHub Copilot alternatives , all were launched at least a year after GitHub Copilot’s 2021 launch except Tabnine, launched in 2019. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineer 239

Software Engineer Software Engineering Programming Language Media 239

Cloudera

MAY 26, 2021

A 2019 report identified that companies are more worried about inadvertent insider breaches(71%), negligent data breaches (65%), and malicious intent by bad actors (60%) than they are about compromised accounts/machines (9%). . The post Auditing to external systems in CDP Private Cloud Base appeared first on Cloudera Blog.

Systems 73

Systems Cloud Hadoop Healthcare 73

Confluent

OCTOBER 16, 2019

As with any system out there, the data often needs processing before it can be used. In traditional data warehousing, we’d call this ETL, and whilst more “modern” systems might not recognise this term, it’s what most of us end up doing whether we call it pipelines or wrangling or engineering. Handling time.

Kafka 19

Kafka Building Data Coding 19

Confluent

MAY 30, 2019

Built with Prometheus and InfluxDB monitoring systems. To build an event streaming pipeline, Spring Cloud Data Flow provides a set of application types: A source represents the first step in the data pipeline, a producer that extracts data from the external systems like databases, filesystem, FTP servers, IoT devices, etc.

Kafka 95

Kafka Cloud Data Pipeline PostgreSQL 95

Jesse Anderson

JANUARY 9, 2023

In 2019, Alibaba bought Ververica. This comparison seems like a clear point that Flink will be the system of choice. Streaming systems are already difficult enough and adding more complexity to the choice with lead to analysis paralysis. That’s because it was recently founded, but that doesn’t mean it wasn’t formidable.

Kafka 147

Kafka Technology Coding SQL 147

Cloudera

AUGUST 12, 2021

A 2020 retention report by the Work Institute revealed that over 42 million employees in the US left their jobs voluntarily in 2019, and this trend appeared to be increasing. A 2019 HBR article mentioned how organizational decisions backed by data have instilled more confidence and reduced risk. Risk Management.

Manufacturing 111

Manufacturing Insurance Consulting Education 111

Knowledge Hut

OCTOBER 4, 2023

Below are the Power BI requirements for the system. Supported operating system: Power BI program can be installed in a device with the following operations systems. Windows Server 2019 Data Centre, server 2019 standard, server 2016 standard, server 2016 datacenter.

BI 52

BI Systems Raw Data Data Preparation 52

Lyft Engineering

JUNE 8, 2023

We’re looking for driven engineers to fortify our European operations and solve some of the hardest problems in building large distributed systems to support rideshare, mapping, and more. Lyft was founded in 2012 and went public in 2019, with the mission to improve people’s lives with the world’s best transportation.

Transportation 111

Transportation Algorithm Machine Learning Engineering 111

Cloudera

MAY 27, 2021

An authoritarian regime is manipulating an artificial intelligence (AI) system to spy on technology users. When developing ethical AI systems, the most important part is intent and diligence in evaluating models on an ongoing basis,” said Santiago Giraldo Anduaga, director of product marketing, data engineering and ML at Cloudera.

Algorithm 119

Algorithm Media Consulting Machine Learning 119

KDnuggets

SEPTEMBER 30, 2019

This thorough review focuses on the impact of AI, 5G, and edge computing on the healthcare sector in the 2020s as well as a look at quantum computing's potential impact on AI, healthcare, and financial services.

Healthcare 107

Healthcare Systems IT 107

Edureka

FEBRUARY 12, 2025

Software Engineers, on the other hand, specialize in building and developing comprehensive systems, with an emphasis on architectural and engineering concepts. On the other hand, a Software Engineer focuses on specific areas of development, such as system design, algorithms, or a programming language.

Software Engineer 52

Software Engineer Software Engineering Computer Science Programming Language 52

Pinterest Engineering

FEBRUARY 3, 2025

At Pinterest Homefeed, we use engaged sessions to measure the impact of recommendation system iterations, which are continuous interaction sessions larger than 60 seconds. Advances in neural information processing systems 30(2017). [4] Advances in neural information processing systems 30(2017). [5] 3] Vaswani, Ashish, et al.

Machine Learning 51

Machine Learning Engineering Architecture Systems 51

Netflix Tech

NOVEMBER 2, 2020

How viewers are able to watch their favorite show on Netflix while the infrastructure self-recovers from a system failure By Manuel Correa , Arthur Gonigberg , and Daniel West Getting stuck in traffic is one of the most frustrating experiences for drivers around the world. Logs and background requests are examples of this type of traffic.

Architecture 107

Architecture Systems Engineering Utilities 107

Cloudera

DECEMBER 14, 2021

But with growing demands, there’s a more nuanced need for enterprise-scale machine learning solutions and better data management systems. They created a system to spread data across several servers with GPU-based processing so large datasets could be managed more effectively across the board. .

Transportation 111

Transportation Telecommunication Banking Data Lake 111

LinkedIn Engineering

OCTOBER 19, 2023

Over time, LinkedIn's engineering team expanded the stream processing ecosystem with more proprietary tools like Brooklin , facilitating data streaming across multiple stores and messaging systems, and Venice , serving as a storage system for ingesting batch and stream processing job outputs, among others.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Confluent

SEPTEMBER 6, 2019

Now imagine event sourcing in the context of an online order system: you place an order and are able to get status updates when your order is confirmed, fulfilled, and shipped. In fact, it’s the summation of these events that result in our current account balance. This, in a nutshell, is event sourcing. Event sourcing: primary vs. derivative.

Kafka 22

Kafka MySQL Banking Java 22

Towards Data Science

FEBRUARY 15, 2023

The Data Lake architecture was proposed in a period of great growth in the data volume, especially in non-structured and semi-structured data, when traditional Data Warehouse systems start to become incapable of dealing with this demand. Let’s add the readings from 2019. Legend says, that this didn’t go well. The data became useless.

Data Lake 98

Data Lake Data Warehouse Hadoop Architecture 98

Cloudera

DECEMBER 1, 2023

Launched in 2019, this strategy aims to position the US as a leader in AI research, development, and deployment. A breach or compromise of AI systems can have severe consequences, potentially compromising sensitive citizen data or even disrupting critical services. million), among others.

Building 109

Building Government Transportation Data Governance 109

Engineering at Meta

DECEMBER 6, 2023

This is the most significant milestone yet for this project, which began in earnest after Mark Zuckerberg outlined his vision for it in 2019. Neither WhatsApp nor Secret Conversations operated in this manner, and we didn’t want all users to have to rely on a device-side storage system.

Building 145

Building Designing Consulting Accessible 145

Engineering at Meta

FEBRUARY 6, 2023

The app makes heavy use of code generation, spurred by Buck , our custom build system. Without heavy caching from our build system, engineers would have to spend an entire workday waiting for the app to build. Swift wouldn’t be announced for a few months , and SwiftUI (Apple’s declarative UI framework) wouldn’t be announced until 2019.

Architecture 145

Architecture Coding Engineering Systems 145

Cloudera

DECEMBER 3, 2021

In 2019, the Gradient institute published a white paper outlining the practical challenges for Ethical AI. They identified four main categories: capturing intent, system design, human judgement & oversight, regulations. An AI system trained on data has no context outside of that data. System Design. Capturing Intent.

Government 102

Government Hospitality Education Designing 102