Engineering at Meta

FEBRUARY 4, 2025

Here we explore initial system designs we considered, an overview of the current architecture, and some important principles Meta takes into account in making data accessible and easy to understand. 2019: Users can view their activity off Meta-technologies and clear their history. What are data logs?

Accessibility 93

Accessibility Accessible Raw Data Data Warehouse 93

Cloudera

MARCH 13, 2019

The Data Heroes initiative is one of the ways that we recognize customers who achieve outstanding results with Cloudera technologies. Data Scientist Nominees : Babylon Health – Utilizing HDP and HDF for analytics on diagnostics, usage of e-health apps, with feedback into their AI platform to create a decision support system for doctors.

Data Architect 69

Data Architect Banking Utilities Deep Learning 69

The Pragmatic Engineer

MARCH 19, 2024

When we looked at GitHub Copilot alternatives , all were launched at least a year after GitHub Copilot’s 2021 launch except Tabnine, launched in 2019. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineer 323

Software Engineer Software Engineering Programming Language Media 323

Confluent

OCTOBER 1, 2019

If you looked at the Kafka Summits I’ve been a part of as a sequence of immutable events (and they are, unless you know something about time I don’t), it would look like this: New York City 2017, San Francisco 2017, London 2018, San Francisco 2018, New York City 2019, London 2019, San Francisco 2019. Yes, you read that right.

Kafka 14

Kafka Database Cloud Systems 14

The Pragmatic Engineer

MAY 11, 2023

Datadog is a leading observability tooling provider which went public in 2019, with a current market cap of $28B. A quick summary of these technologies: Prometheus : a time series database. A very popular open-source solution for systems and services monitoring. To get full newsletters twice a week, subscribe here.

AWS 339

AWS Software Engineer Software Engineering Google Cloud 339

Confluent

SEPTEMBER 23, 2019

Conferences are one of the best places to chat with, interact with—dare I even say network with people using the same technologies you are. Kafka Summit San Francisco 2019 is located at the Hilton San Francisco Union Square. His particular interests are analytics, systems architecture, performance testing, and optimization.

Kafka 18

Kafka Hadoop Architecture Database 18

Confluent

FEBRUARY 20, 2019

As you may know, we have adopted a happy medium: three Summits in 2019. Anyway, let me remind you of the dates and places: Kafka Summit New York – April 2, 2019. Kafka Summit London – May 13-14, 2019. March 28, 2019, at 2:00 p.m. I still think that’s a lot. Kafka Summit San Francisco – Sept. San Francisco CFP is open.

Kafka 66

Kafka Programming Architecture Technology 66

Confluent

OCTOBER 9, 2019

How Kroger Embraced a “Schema-First” Philosophy in Building Real-Time Data Pipelines by Rob Hoeting, Rob Hammonds, and Lauren McDonald of Systems Evolution. Tim Berglund is a teacher, author and technology leader with Confluent, where he serves as the senior director of developer experience. Photo Credit: Derek C.

Kafka 17

Kafka Software Engineer Software Engineering Data Pipeline 17

Confluent

SEPTEMBER 30, 2019

On the agenda for day two: a keynote from Confluent CEO Jay Kreps, a Q&A with Lyft, more sessions and, I am told, more on-demand donuts… Tim Berglund is a teacher, author and technology leader with Confluent, where he serves as the senior director of developer experience. and all over the world.

Kafka 17

Kafka Architecture Cloud Designing 17

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. How has your view of the principles of the data mesh changed since our conversation in July of 2019?

BI 130

BI Data Warehouse Data Engineer Data Engineering 130

Cloudera

MAY 22, 2019

The 2019 Data Impact Awards recognize organizations’ achievements with the Cloudera platform in seven categories: DATA FROM THE EDGE-TO-AI. Organizations that move their business to the next level and disrupt their industry by identifying new technologies, applying new skills, and operationalizing processes. Award Categories.

Pharmaceutical 56

Pharmaceutical Machine Learning Recruitment Data Architecture 56

Netflix Tech

DECEMBER 10, 2019

Fall 2019 By Tom Richards , Carenina Garcia Motion , and Leslie Posada Hack Day at Netflix is an opportunity to build and show off a feature, tool, or quirky app. The goal is simple: experiment with new ideas/technologies, engage with colleagues across different disciplines, and have fun! Netflix Hack Day?—?Fall 2018 Netflix Hack Day?

Technology 52

Technology Project Systems Building 52

Netflix Tech

DECEMBER 10, 2019

Fall 2019 By Tom Richards , Carenina Garcia Motion , and Leslie Posada Hack Day at Netflix is an opportunity to build and show off a feature, tool, or quirky app. The goal is simple: experiment with new ideas/technologies, engage with colleagues across different disciplines, and have fun! Netflix Hack Day?—?Fall 2018 Netflix Hack Day?

Technology 52

Technology Project Systems Building 52

Jesse Anderson

JANUARY 9, 2023

Now, we’re seeing the market’s reaction to the technologies. In 2019, Alibaba bought Ververica. While the technology sector has had a tough time, that started in May 2022. This comparison seems like a clear point that Flink will be the system of choice. They were both in the same area with many of the same technologies.

Kafka 147

Kafka Technology Coding Project 147

Cloudera

MAY 27, 2021

An authoritarian regime is manipulating an artificial intelligence (AI) system to spy on technology users. No matter how good the intentions behind the development of a technology, someone is bound to corrupt and manipulate it. Right now, someone somewhere is writing the next fake news story or editing a deepfake video.

Algorithm 119

Algorithm Media Consulting Machine Learning 119

The Pragmatic Engineer

MAY 1, 2024

When we looked at GitHub Copilot alternatives , all were launched at least a year after GitHub Copilot’s 2021 launch except Tabnine, launched in 2019. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineer 239

Software Engineer Software Engineering Programming Language Media 239

Edureka

FEBRUARY 12, 2025

Software Engineers, on the other hand, specialize in building and developing comprehensive systems, with an emphasis on architectural and engineering concepts. Full Stack Developers have experience with a wide range of programming languages and technologies, as well as the complete stack. This is the”depth” of their skill.

Software Engineer 52

Software Engineer Software Engineering Computer Science Programming Language 52

Cloudera

DECEMBER 19, 2018

Natural language analytics and streaming data analytics are emerging technologies that will impact the market. Big Data Technologies and Architectures. Research by Dresner indicates the emerging technologies of natural language analysis and streaming data analytics have jumped in importance over the last year.

BI 52

BI Cloud Computing Data Warehouse Big Data 52

Cloudera

AUGUST 12, 2021

A 2020 retention report by the Work Institute revealed that over 42 million employees in the US left their jobs voluntarily in 2019, and this trend appeared to be increasing. A 2019 HBR article mentioned how organizational decisions backed by data have instilled more confidence and reduced risk. Risk Management.

Manufacturing 111

Manufacturing Insurance Consulting Education 111

Lyft Engineering

JUNE 8, 2023

We’re looking for driven engineers to fortify our European operations and solve some of the hardest problems in building large distributed systems to support rideshare, mapping, and more. Lyft was founded in 2012 and went public in 2019, with the mission to improve people’s lives with the world’s best transportation.

Transportation 110

Transportation Algorithm Machine Learning Engineering 110

Cloudera

DECEMBER 1, 2023

Recent Government Initiatives on Public Sector AI Solutions In recent years, governments across the globe have recognized the transformative potential of artificial intelligence (AI) and have embarked on initiatives to harness this technology to drive innovation and serve their citizens more effectively. million), among others.

Building 109

Building Government Transportation Data Governance 109

Cloudera

DECEMBER 14, 2021

But with growing demands, there’s a more nuanced need for enterprise-scale machine learning solutions and better data management systems. So to improve the speed of data analysis, the IRS worked with the combined technology integrating Cloudera Data Platform (CDP) and NVIDIA’s RAPIDS Accelerator for Apache Spark 3.0.

Transportation 111

Transportation Telecommunication Banking Data Lake 111

Engineering at Meta

DECEMBER 6, 2023

This is the most significant milestone yet for this project, which began in earnest after Mark Zuckerberg outlined his vision for it in 2019. End-to-end encryption isn’t about the technology at its core. Some of these just had to be rebuilt from scratch, while others required deploying new applied privacy technology.

Building 145

Building Designing Consulting Accessible 145

Snowflake

SEPTEMBER 21, 2023

The marketing technology landscape has exploded in the last decade. 360-degree customer view broken into 120 data silos As of 2019, the average enterprise used 120 marketing applications. 360-degree customer view broken into 120 data silos As of 2019, the average enterprise used 120 marketing applications.

Google Cloud 111

Google Cloud Unstructured Data Technology Data 111

Cloudera

FEBRUARY 8, 2021

billion in 2019, and is projected to reach $225.16 As advanced use cases, like advanced driver assistance systems featuring lane change departure detection, advanced vehicle diagnostics, or predictive maintenance move forward, the existing infrastructure of the connected car is being stressed. billion by 2027, registering a CAGR of 17.1%

Manufacturing 108

Manufacturing Machine Learning Data Ingestion Electronics 108

U-Next

FEBRUARY 26, 2023

The company has worked with over 2,000 customers across various industries, such as retail, financial services, healthcare, and technology. Average Salary per annum: INR 10 lakhs Number of Employees: 1361 Amazon Amazon is a multinational technology company based in Seattle, Washington. Average Salary per annum: INR 34.2

Data Science 98

Data Science Machine Learning Consulting Data Mining 98

Zalando Engineering

JUNE 23, 2021

Introduction In our previous post about Technology Choices at Zalando we spoke about a few problems with scaling technology selection in Tech companies. Now, we'd like to reflect on our lessons learned, which you can use when designing technology selection processes. Such individuals are also essential for continued innovation.

Technology 52

Technology Data Lake PostgreSQL AWS 52

Confluent

MAY 14, 2019

A technology community is made up of people. These individuals have provided great value to the technology and the community, and we would like to recognize them for their exceptional contributions. The selection process for the 2020 class will end on August 15, 2019, after which you will begin to hear from us.

Programming 84

Programming Kafka Education Coding 84

LinkedIn Engineering

OCTOBER 19, 2023

This technology has optimized cost-to-serve by 2x by unifying stream and batch processing through Apache Samza and Apache Spark runners, enabled real-time ML feature generation, reduced time-to-production for new pipelines from months to days, allowed for processing time-series events at over 3 million queries per second, and more.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Netflix Tech

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 40

AWS Entertainment Software Engineer Software Engineering 40

Netflix Tech

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 40

AWS Entertainment Software Engineer Software Engineering 40

Towards Data Science

FEBRUARY 15, 2023

Data architecture is the set of practices, technologies, and services that meet the data demand of a given organization, both technical (speed, volume, frequency, availability) and non-technical (business rules, compliance with data legislation) needs. Let’s add the readings from 2019. Legend says, that this didn’t go well.

Data Lake 98

Data Lake Data Warehouse Hadoop Architecture 98

Cloudera

NOVEMBER 26, 2020

This award recognized organizations that have built and deployed systems for enterprise-scale machine learning (ML) and have industrialized AI to automate, secure, and standardize data-driven decision making. We believe next year will deliver some real treasures in terms of artificial intelligence (AI) and ML innovation.

Machine Learning 105

Machine Learning Big Data Data Database 105

The Pragmatic Engineer

JULY 13, 2023

Until 2019, the company had only 8 locations, which limited their customer base. At first, the company blamed the pause of sales on a bug in their system, then confirmed that pausing sales was intentional. That small tweak had an outsized impact. Overnight, our shipping damages dropped by 70-80%.”

Google Cloud 178

Google Cloud Retail Manufacturing Cloud 178

Confluent

SEPTEMBER 6, 2019

Now imagine event sourcing in the context of an online order system: you place an order and are able to get status updates when your order is confirmed, fulfilled, and shipped. In fact, it’s the summation of these events that result in our current account balance. This, in a nutshell, is event sourcing. Event sourcing: primary vs. derivative.

Kafka 22

Kafka MySQL Banking Java 22

Cloudera

DECEMBER 3, 2021

In 2019, the Gradient institute published a white paper outlining the practical challenges for Ethical AI. They identified four main categories: capturing intent, system design, human judgement & oversight, regulations. An AI system trained on data has no context outside of that data. System Design. Capturing Intent.

Government 102

Government Hospitality Education Designing 102

AltexSoft

JULY 23, 2022

In October 2019, Microsoft reported artificial intelligence helped manufacturing companies outperform rivals stating that manufacturers adopting AI perform 12 percent better than their competitors.Therefore, we are likely to see the outburst of AI-based technologies in manufacturing along with the advent of new highly-paid workplaces in this area.

Manufacturing 52

Manufacturing Technology Machine Learning Transportation 52