Engineering at Meta

DECEMBER 6, 2023

This is the most significant milestone yet for this project, which began in earnest after Mark Zuckerberg outlined his vision for it in 2019. The post Building end-to-end security for Messenger appeared first on Engineering at Meta. They are built leveraging our E2EE infrastructure and provide an increased level of privacy.

Building 144

Building Designing Consulting Accessibility 144

The Pragmatic Engineer

MAY 11, 2023

Datadog is a leading observability tooling provider which went public in 2019, with a current market cap of $28B. Prometheus is part of the Cloud Native Foundation, membership of which indicates that it’s safe to build on top of Prometheus, as it’s actively maintained and will continue to be. But why is this?

AWS 347

AWS Software Engineer Software Engineering Google Cloud 347

Confluent

MAY 23, 2019

She recounted a number of lessons Confluent has learned in building Confluent Cloud, and announced the availability of several new features in the cloud service. ?. Keith Davidson (Director of Group TV Distribution Platforms, Sky) told us how to “Grow a Great Engineering Culture with Apache Kafka.”

Kafka 109

Kafka Cloud Database Engineering 109

KDnuggets

SEPTEMBER 27, 2019

This live webinar, Oct 2 2019, will instruct data scientists and machine learning engineers how to build manage and deploy auto-adaptive machine learning models in production. Save your spot now.

Machine Learning 95

Machine Learning Building Engineering Management 95

KDnuggets

AUGUST 12, 2019

We’ll now look at a number of research papers on covering state-of-the-art approaches to building semantic segmentation models. These labels could include a person, car, flower, piece of furniture, etc., just to mention a few.

Building 99

Building Process Python 99

Confluent

APRIL 16, 2019

To build the kinds of systems we are being called upon to build these days, we need infrastructure that gives equal priority to events and state together. and a couple of fantastic keynotes: Jay Kreps (CEO of Confluent and co-creator of Apache Kafka ® ) kept the unifying vision of the event streaming platform in front of us.

Kafka 102

Kafka Database Programming Systems 102

Cloudera

DECEMBER 1, 2023

Launched in 2019, this strategy aims to position the US as a leader in AI research, development, and deployment. It focuses on five key pillars: investing in research and development; unleashing government AI resources; setting standards and policy; building the AI workforce; and advancing trust and security. million), among others.

Building 109

Building Government Transportation Data Governance 109

The Pragmatic Engineer

NOVEMBER 21, 2023

  He then worked at the casual games company Zynga, building their in-game advertising platform.   We didn’t build our applications in neat containers, but in bulky monoliths which commingled business, database, backend, and frontend logic. Our deployments were initially manual.

Engineering 345

Engineering Bytes Cloud Computing AWS 345

The Pragmatic Engineer

MAY 1, 2024

A first, smaller wave of these stories included Magic.dev raising $100M in funding from Nat Friedman (CEO of GitHub from 2018-2021,) and Daniel Gross (cofounder of search engine Cue which Apple acquired in 2013,) to build a “superhuman software engineer.” AI dev tool startups need outlandish claims to grab attention.

Software Engineer 246

Software Engineer Software Engineering Programming Language Media 246

The Pragmatic Engineer

APRIL 6, 2023

This created an opportunity to build job sites which collect this data, make it easy to browse, and allow job seekers to apply to jobs paying at or above a certain level. He shared: “I'd preface everything by saying that this is very much a v1 of our jobs product and we plan to iterate and build a lot more as we get feedback.

Software Engineer 236

Software Engineer Software Engineering Datasets Database 236

Confluent

AUGUST 20, 2019

Let’s assume we want to build a multi-tenant system. Together with Kafka Streams, they can be used as a building block for connecting a landscape of services with exactly once semantics. There are many different ways to build systems around Apache Kafka and this article presented just one. A simple multi-tenant system.

Kafka 22

Kafka Systems Building Relational Database 22

Confluent

OCTOBER 9, 2019

Based on the votes of Summit attendees from within the Kafka Summit mobile app, here are the top-rated talks: Building Stream Processing Applications with Apache Kafka Using KSQL by Robin Moffatt of Confluent. With so many sessions to choose from, perhaps you’re wondering where to start. Why Stop the World When You Can Change It?

Kafka 17

Kafka Software Engineer Software Engineering Data Pipeline 17

Confluent

OCTOBER 16, 2019

This article has shown how Apache Kafka as part of Confluent Platform can be used to build a powerful data system. . | Date | Variation | Arriva | East Mid | LNER | TPE | + + -+ --+ -+ + -+. These are useful for understanding the data during iterations of pipeline development: Fast track to streaming ETL.

Kafka 19

Kafka Building Data Coding 19

Data Engineering Podcast

SEPTEMBER 2, 2019

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode.

Building 100

Building Data Database Design Media 100

KDnuggets

DECEMBER 17, 2019

Check out this step by step approach to building an intelligent chatbot in Python.

Building 123

Building Python 123

The Pragmatic Engineer

JUNE 22, 2023

In 2019, Sundar Pichai wrote an opinion piece in The New York Times, where he recorded a powerful commitment (emphasis mine) “To make privacy real, we give you clear, meaningful choices around your data. Obviously, there are plenty of questions. Does this count as selling personal information to a third party?

Google Cloud 304

Google Cloud Media Cloud Engineering 304

Netflix Tech

OCTOBER 19, 2020

This insight led us to build Edgar: a distributed tracing infrastructure and user experience. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. The following sections describe our journey in building these components.

Building 95

Building Transportation Java Metadata 95

KDnuggets

DECEMBER 13, 2019

We show how to build intuitive and useful pipelines with Pandas DataFrame using a wonderful little library called pdpipe.

Building 123

Building Data Preparation Python Data 123

Confluent

SEPTEMBER 30, 2019

I even stopped by Build-A-Bear at lunchtime with the inaugural class of Confluent Community Catalysts ! It’s fair to say I had a very productive morning and afternoon breaks… Checked out the on-demand donut station. And, I saw fresh Kafka swag in the making.

Kafka 17

Kafka Architecture Cloud Designing 17

KDnuggets

SEPTEMBER 6, 2019

Hone your practical speech recognition application skills with this overview of building a voice assistant using Python.

Building 108

Building Python Machine Learning 108

Confluent

OCTOBER 8, 2019

They’re a Customer Project of the Year finalist for 2019’s Computing Technology Product Awards , and we couldn’t be more proud. As a company that can trace its roots back to 1602, reinventing the way it does business was a major undertaking.

Building 16

Building Kafka Data Warehouse Project 16

Pinterest Engineering

JANUARY 4, 2024

In order to build a distributed and replicated service using RocksDB, we built a real time replicator library: Rocksplicator. Motivation As explained in this blog post , in 2019, Pinterest had four different key-value services with different storage engines including RocksDB, HBase, and HDFS. RocksDB is a single node key value store.

Database 98

Database Building Datasets Relational Database 98

KDnuggets

AUGUST 30, 2019

Implement some of the core OOP principles in a machine learning context by building your own Scikit-learn-like estimator, and making it better.

Programming 122

Programming Building Machine Learning Data 122

Yelp Engineering

OCTOBER 7, 2024

In 2019, Yelp’s Core Android team led an effort to boost navigation performance in Yelp’s Consumer app. We switched from building screens with multiple separate activities to using fragments inside a single activity.

Building 102

Building IT 102

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. How has your view of the principles of the data mesh changed since our conversation in July of 2019?

BI 130

BI Data Warehouse Data Engineering Data Engineer 130

The Pragmatic Engineer

MARCH 3, 2023

For example, in 2019, the online round featured a challenge relating to a problem with Google Photos : “ Introduction : As the saying goes, "a picture is worth a thousand words." More details about this conference on its website. " We agree – photos are an important part of contemporary digital and cultural life.

Coding 218

Coding IT Software Engineer Software Engineering 218

KDnuggets

NOVEMBER 1, 2019

This article focused on building an Artificial Neural Network using the Numpy Python library.

Building 110

Building Python 110

Netflix Tech

MARCH 28, 2025

These insights have shaped the design of our foundation model, enabling a transition from maintaining numerous small, specialized models to building a scalable, efficient system. It enables large-scale semi-supervised learning using unlabeled data while also equipping the model with a surprisingly deep understanding of world knowledge.

Metadata 84

Metadata Bytes Data Mining Entertainment 84

Snowflake

SEPTEMBER 14, 2023

The Snowflake Data Cloud gives you the flexibility to build a modern architecture of choice to unlock value from your data. In 2019, the company embarked on a mission to modernize and simplify its data platform. Prior to 2019, Marriott was an early adopter of Netezza and Hadoop, leveraging the IBM BigInsights platform.

Data Architecture 122

Data Architecture Architecture Hadoop Data Warehouse 122

Cloudera

AUGUST 12, 2021

A 2020 retention report by the Work Institute revealed that over 42 million employees in the US left their jobs voluntarily in 2019, and this trend appeared to be increasing. This is especially important for organizations to set and meet diversity, equity and inclusion targets to build well-rounded and successful teams. .

Manufacturing 111

Manufacturing Insurance Consulting Education 111

Engineering at Meta

FEBRUARY 4, 2025

2019: Users can view their activity off Meta-technologies and clear their history. Current design Finally, we considered whether it would be possible to build a system that relies on amortizing the cost of expensive full table scans by batching individual users requests into a single scan. feature on Facebook.

Accessible 81

Accessible Accessibility Raw Data Data Warehouse 81

Confluent

MAY 30, 2019

To build an event streaming pipeline, Spring Cloud Data Flow provides a set of application types: A source represents the first step in the data pipeline, a producer that extracts data from the external systems like databases, filesystem, FTP servers, IoT devices, etc. BUILD-SNAPSHOT.

Kafka 95

Kafka Cloud Data Pipeline PostgreSQL 95

Jesse Anderson

JANUARY 9, 2023

In 2019, Alibaba bought Ververica. That’s because it was recently founded, but that doesn’t mean it wasn’t formidable. The story starts with Data Artisans (later renamed to Ververica). It employed some of the top people in the Apache Flink project. Let’s just say this wasn’t the smoothest working relationship.

Kafka 147

Kafka Technology Coding SQL 147

KDnuggets

OCTOBER 31, 2019

A hands on guide to Logistic Regression for aspiring data scientist and machine learning engineer.

Python 122

Python Building Machine Learning Engineering 122

Lyft Engineering

JUNE 8, 2023

We’re looking for driven engineers to fortify our European operations and solve some of the hardest problems in building large distributed systems to support rideshare, mapping, and more. Lyft was founded in 2012 and went public in 2019, with the mission to improve people’s lives with the world’s best transportation.

Transportation 104

Transportation Algorithm Machine Learning Engineering 104

Snowflake

DECEMBER 7, 2023

in 2018 , Firefox blocked third-party cookies by default with Firefox ETP in 2019 , and Google first announced blocking of third-party cookies on Chrome in 2019. Ultimately, this allows retailers to build an identity spine and customer 360 view. Identity data has two categories: pseudonymous and known.

Retail 105

Retail Media Digital Media Data 105

Christophe Blefari

MAY 17, 2024

Why Microsoft invested in OpenAI in 2019 — Emails explaining why Satya Nadella (CEO) and Kevin Scott (CTO) pushed Microsoft to invest in OpenAI have been made public, and are worth a look. dltHub REST API source toolkit — dlt released a toolkit to build extract and load pipelines on top of custom APIs.

Food 130

Food Data BI Engineering 130