The Pragmatic Engineer

MAY 12, 2023

I recommend exercising caution regarding OpsGenie, given how in 2022, OpsGenie was down for hundreds of customers for 2 weeks. For a realtime alerting system! Be wary of OpsGenie's past reliability incident. Yes: 2 for weeks! Unlucky customers had no option but to move to alternative alerting/incident management providers.

Systems 276

Systems Management Engineering IT 276

The Pragmatic Engineer

NOVEMBER 9, 2023

Here is software engineer and writer Molly White summarizes of his evidence : “To hear Singh tell it, he didn’t even really realize what was going on at FTX and Alameda Research until September 2022 — only a month or two before everything came crashing down. (.) FTX collapsed in November 2022.

Software Engineer 277

Software Engineer Software Engineering Engineering Coding 277

Snowflake

NOVEMBER 26, 2024

A consolidated data system to accommodate a big(ger) WHOOP When a company experiences exponential growth over a short period, it’s easy for its data foundation to feel a bit like it was built on the fly. This blog post is the second in a three-part series on migrations.

Data Warehouse 102

Data Warehouse Cloud PostgreSQL Hadoop 102

Lyft Engineering

APRIL 3, 2023

This blog post focuses on the scope and the goals of the recommendation system, and explores some of the most recent changes the Rider team has made to better serve Lyft’s riders. Introduction: Scope of the Recommendation System The recommendation system covers user experiences throughout the ride journey.

Systems 90

Systems Pipeline-centric Machine Learning Transportation 90

The Pragmatic Engineer

APRIL 13, 2023

Source: Dealroom In 2022, Angel rounds were at the lowest by cumulative value since 2015, which is even worse than we’ve seen in the US. Source: Dealroom Seed investments have dropped since 2021, but in 2022 were around the same level as in 2020 – and well above 2019. Seed investments in Europe.

Finance 230

Finance Media Software Engineer Software Engineering 230

The Pragmatic Engineer

JUNE 1, 2023

Juraj included system monitoring parts which monitor the server’s capacity he runs the app on: The monitoring page on the Rides app And it doesn’t end here. Juraj created a systems design explainer on how he built this project, and the technologies used: The systems design diagram for the Rides application The app uses: Node.js

Education 364

Education Project PostgreSQL Software Engineer 364

The Pragmatic Engineer

NOVEMBER 21, 2023

If you had a continuous deployment system up and running around 2010, you were ahead of the pack: but today it’s considered strange if your team would not have this for things like web applications.  We dabbled in network engineering, database management, and system administration. and hand-rolled C -code.

Engineering 337

Engineering Bytes Cloud Computing AWS 337

Scott Logic

JANUARY 16, 2023

Noting that transformation is hard, he uses the term “immune system” to describe how a company/organisation naturally and unintentionally tends to fight/resist change. Everything You Should Know About Web Development in 2022 Stefan Judis took us through the highlights of what’s new in the web space this year.

Generalist 83

Generalist Coding Java Education 83

The Pragmatic Engineer

JUNE 8, 2023

Shopify’s stock value fell 29% between September 2021 and September 2022: Shopify’s stock price change, versus the S&P 500 index, between September 2021 and 2022 The most common way companies respond to such drastic stock declines are these: Issue higher equity refreshers , intended to counter a falling stock price.

Software Engineer 174

Software Engineer Software Engineering Media Engineering 174

Cloudera

JUNE 13, 2022

We are excited to announce that Cloudera is named as a 2022 Gartner Peer Insights Customers’ Choice for Cloud Database Management Systems (DBMS). As of Mar 2022, Cloudera customers provided 81 reviews, and we earned an average Overall Rating of 4.5. What do our customers say about Cloudera? . We take your feedback to heart.

Hadoop 73

Hadoop Manufacturing Finance Media 73

Precisely

SEPTEMBER 23, 2024

More specifically, these companies use IBM Z systems. The most recent version, IBM z16, was released in April of 2022. This growth is driven by the ongoing need for reliable, high-capacity computing systems, particularly in sectors like banking, finance, and government​. Mainframes are used by 71% of Fortune 500 companies.

Banking 115

Banking Insurance Finance Systems 115

Jesse Anderson

JANUARY 9, 2023

2022 was a banner year for activity.” In 2022, many of the Ververica employees left and formed Immerok. You can see a significant drop starting in March 2022. While the technology sector has had a tough time, that started in May 2022. Confluent’s problems began months earlier, in February 2022.

Kafka 147

Kafka Technology Coding SQL 147

Netflix Tech

SEPTEMBER 29, 2022

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Systems 92

Systems Metadata Media Kafka 92

The Pragmatic Engineer

JANUARY 5, 2023

We also recommend customers review internal logs for their systems for any unauthorized access starting from December 21, 2022, through today, January 4, 2023, or upon completion of your secrets rotation. (.)We We take the security of our systems and our customers’ systems extremely seriously.

Pipeline-centric 130

Pipeline-centric Database-centric Coding Accessibility 130

The Pragmatic Engineer

MARCH 19, 2024

The Cognition AI team smashed it on media attention; it feels like their launch garnered almost as much developer attention as ChatGPT’s launch in November 2022. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineer 323

Software Engineer Software Engineering Programming Language Media 323

Data Engineering Podcast

SEPTEMBER 10, 2023

Summary Data systems are inherently complex and often require integration of multiple technologies. Can you start by defining what data orchestration is and how it differs from other types of orchestration systems? Can you start by defining what data orchestration is and how it differs from other types of orchestration systems?

BI 208

BI SQL Machine Learning Data 208

Snowflake

APRIL 9, 2025

Conviction is a venture firm founded in 2022 to invest in intelligent software, or "Software 3.0" KAWA Analytics Digital transformation is an admirable goal, but legacy systems and inefficient processes hold back many companies efforts. " companies.

Pharmaceutical 97

Pharmaceutical Manufacturing Data Ingestion SQL 97

The Pragmatic Engineer

SEPTEMBER 26, 2023

Codeanywhere : one of the earliest cloud IDEs, founded in 2013 Daytona was founded in 2023, and its founders are the cofounders of Codeanywhere.

Cloud 309

Cloud Software Engineer Software Engineering Cloud Computing 309

DoorDash Engineering

APRIL 4, 2023

This is the third blog post in a series of articles showcasing our 2022 summer intern projects. Today these changes are entered as single entry systems that are prone to errors and difficult to reconcile. The post 2022 Summer Intern Projects Article #3 appeared first on DoorDash Engineering Blog.

Project 75

Project Banking Kafka Database 75

The Pragmatic Engineer

OCTOBER 10, 2023

I wrote code for drivers on Windows, and started to put a basic observability system in place. EC2 had no observability system back then: people would spin up EC2 instances but have no idea whether or not they worked. With my team, we built the basics of what is now called AWS Systems Manager.

Software Engineer 318

Software Engineer Software Engineering Architecture Media 318

The Pragmatic Engineer

OCTOBER 10, 2022

Starting from 2022, they run once a year. ” In 2022, the first such quarterly review or touchpoint was April. So yes, the performance review process is new for 2022, but it’s only new because it’s different from the previous one, which was biannual (every 6 months.) So, how will they reach this goal?

Engineering 130

Engineering Software Engineer Software Engineering Recruitment 130

The Pragmatic Engineer

OCTOBER 10, 2024

Wordpress is the most popular content management system (CMS),  estimated  to power around 43% of all websites; a staggering number! To maintain 2021-2022 valuations, companies need to increase revenue and profitability. This article was originally published a week ago, on 3 October 2024, in The Pragmatic Engineer.

Consulting 345

Consulting AWS Engineering Software Engineer 345

Netflix Tech

JUNE 1, 2023

By Jose Fernandez , Ed Barker , Hank Jacobs Introduction In November 2022, we introduced a brand new tier —  Basic with ads. Replay traffic enabled us to test our new systems and algorithms at scale before launch, while also making the traffic as realistic as possible. Basic with ads was launched worldwide on November 3rd.

Algorithm 141

Algorithm Kafka Metadata Systems 141

Engineering at Meta

JUNE 27, 2023

Sapling: Scaling version control Sapling is a version control system that can scale to huge sizes, but also emphasizes usability. There are three main components to Sapling – a server, a client, and a virtual file system. The final component is the virtual file system. We also have language-specific testing frameworks.

Java 135

Java Programming Language Algorithm Programming 135

Lyft Engineering

MAY 5, 2025

This article explores real-time spatial temporal forecasting models and system designs used for predicting market conditions, focusing on how their complexity and rapid nature affect model performance, selection, and forecasting systemdesign. 2022] , Geng et al. 2022] , Corradini et al. 2023] ; Mojtahedi et al.

Machine Learning 41

Machine Learning Architecture Kafka Systems 41

The Pragmatic Engineer

AUGUST 22, 2023

But even in 2022, the biggest challenge for anyone keen to learn more is that gaming is a sector which is often shrouded in mystery. Programmers are building core systems, artists are establishing the visual aesthetic and style of the game, and designers are establishing gameplay, long-term progression and retention.

Software Engineer 235

Software Engineer Software Engineering Consulting Entertainment 235

The Pragmatic Engineer

AUGUST 10, 2023

I also reached out via official channels to Stack Overflow, and here’s what the company told me (the company later published a blog post with some of the below data included): 5%: the company wrote “overall, we're seeing an average of ~5% less traffic compared to 2022.“

Retail 207

Retail Utilities Software Engineer Software Engineering 207

The Pragmatic Engineer

MARCH 13, 2023

It wasn’t just startups, but also late-stage companies: 44% of venture-backed tech and healthcare companies which went public in 2022 were SVB customers, according to Bloomberg. The bank’s systems start to be overloaded to the point of customers not being able to log on and transfer. What is a bank run?

Banking 233

Banking Insurance Portfolio Media 233

Tweag

MAY 1, 2024

Table of contents Overview Motivation Statistics Retrospective Thoughts on future work Acknowledgements Overview This is a retrospective of my and many other people’s work on documentation in the Nix ecosystem between October 2022 and March 2024. A lot has happened during that time, so this text is quite lengthy.

Project 111

Project Architecture Coding Designing 111

The Pragmatic Engineer

JULY 13, 2023

At first, the company blamed the pause of sales on a bug in their system, then confirmed that pausing sales was intentional. VanMoof appointed the former CEO of Booking.com, Gillian Tans, as president in 2022. Like with Bird , the writing is sadly on the wall that VanMoof goes bankrupt or is sold.

Google Cloud 178

Google Cloud Retail Manufacturing Cloud 178

The Pragmatic Engineer

MAY 1, 2024

The Cognition AI team smashed it on media attention; it feels like their launch garnered almost as much developer attention as ChatGPT’s launch in November 2022. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineer 239

Software Engineer Software Engineering Programming Language Media 239

Engineering at Meta

OCTOBER 15, 2024

AI has been at the core of the experiences Meta has been delivering to people and businesses for years, including AI modeling innovations to optimize and improve on features like Feed and our ads system. For example, Llama 3.1 405B , Meta’s largest model, is a dense transformer with 405B parameters and a context window of up to 128k tokens.

Designing 129

Designing Deep Learning Architecture Systems 129

Data Engineering Podcast

JUNE 11, 2023

Summary Data engineering is all about building workflows, pipelines, systems, and interfaces to provide stable and reliable data. July 2021 and July 2022 about data-diff) What are the roadblocks to data testing/validation that you see teams run into most often? Your data can be stable and wrong, but then it isn't reliable.

Project 130

Project Building Data Lake Machine Learning 130

Lyft Engineering

APRIL 11, 2023

In early 2022, we completed this migration. Runs are the way to use the LyftLearn big data system in both development and production. We will compare the metrics of runs between 2021 and 2022 in development ( dev ) and production ( prod ). Productivity In 2022, we had a huge increase in production usage.

Big Data 96

Big Data SQL Data AWS 96

Precisely

AUGUST 12, 2024

Key Takeaways Legacy CCM systems are damaging to customer satisfaction and employee productivity and are no longer sustainable. But many organizations continue using outdated legacy CCM systems, which can significantly hinder both customer satisfaction and employee productivity and retention.

Systems 52

Systems Technology Machine Learning Data Analytics 52

DoorDash Engineering

MARCH 7, 2023

While most engineering tooling at DoorDash is focused on making safe incremental improvements to existing systems, in part by testing in production (learn more about our end-to-end testing strategy ), this is not always the best approach when launching an entirely new business line. No infrastructure required in the cloud.

AWS 119

AWS PostgreSQL Database SQL 119

U-Next

MARCH 12, 2023

Making use of Date class Making use of Calendar class Using Date Class: In this method, we will build a date class in Java object and then use it to use the function toString() method to acquire the system’s current Java DateTime. getTime()); System.out.println(“Prior change ” neda2); neda2.setTime(204587433443L);

Java 96

Java Programming Language Coding Utilities 96