Confluent

FEBRUARY 20, 2019

As you may know, we have adopted a happy medium: three Summits in 2019. Anyway, let me remind you of the dates and places: Kafka Summit New York – April 2, 2019. Kafka Summit London – May 13-14, 2019. March 28, 2019, at 2:00 p.m. I still think that’s a lot. Kafka Summit San Francisco – Sept. San Francisco CFP is open.

Kafka 66

Kafka Programming Architecture Technology 66

Jesse Anderson

DECEMBER 12, 2022

Google looked over the expanse of the growing internet and realized they’d need scalable systems. With an immutable file system like HDFS, we needed scalable databases to read and write data randomly. We lacked a scalable pub/sub system. I followed that post up in 2019 by showing that data scientists are not data engineers.

Data Engineer 130

Data Engineer Data Engineering Engineering Hadoop 130

The Pragmatic Engineer

OCTOBER 10, 2023

I wrote code for drivers on Windows, and started to put a basic observability system in place. EC2 had no observability system back then: people would spin up EC2 instances but have no idea whether or not they worked. With my team, we built the basics of what is now called AWS Systems Manager. I decided to look around.

Software Engineering 263

Software Engineering Software Engineer Architecture Media 263

Confluent

MAY 23, 2019

He is the co-presenter of various O’Reilly training videos on topics ranging from Git to distributed systems, and is the author of “Gradle Beyond the Basics.” He can frequently be found at speaking at conferences in the U.S. and all over the world.

Kafka 109

Kafka Cloud Database Engineering 109

Netflix Tech

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 40

AWS Entertainment Software Engineering Software Engineer 40

Netflix Tech

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 40

AWS Entertainment Software Engineering Software Engineer 40

Confluent

APRIL 16, 2019

To build the kinds of systems we are being called upon to build these days, we need infrastructure that gives equal priority to events and state together. and a couple of fantastic keynotes: Jay Kreps (CEO of Confluent and co-creator of Apache Kafka ® ) kept the unifying vision of the event streaming platform in front of us.

Kafka 102

Kafka Database Programming Systems 102

Cloudera

DECEMBER 19, 2018

Given the ubiquity of search engines like Google and now voice response systems like Alexa and Google Home, you would have thought that natural language, search-based analytics, and BI would have already become the norm in organizations. Natural Language Analysis and Streaming Data Analytics.

BI 52

BI Cloud Computing Data Warehouse Big Data 52

Cloudera

MAY 26, 2021

A 2019 report identified that companies are more worried about inadvertent insider breaches(71%), negligent data breaches (65%), and malicious intent by bad actors (60%) than they are about compromised accounts/machines (9%). . The post Auditing to external systems in CDP Private Cloud Base appeared first on Cloudera Blog.

Systems 72

Systems Cloud Hadoop Healthcare 72

KDnuggets

AUGUST 23, 2019

Alibaba, the largest e-commerce platform in China, is a powerhouse not only when it comes to e-commerce, but also when it comes to recommender systems research. Their latest paper, Behaviour Sequence Transformer for E-commerce Recommendation in Alibaba, is yet another publication that pushes the state of the art in recommender systems.

Systems 103

Systems IT Engineering 103

KDnuggets

SEPTEMBER 4, 2019

Recommender systems are an important class of machine learning algorithms that offer "relevant" suggestions to users. Categorized as either collaborative filtering or a content-based system, check out how these approaches work along with implementations to follow from example code.

Machine Learning 110

Machine Learning Systems Algorithm Coding 110

Rockset

MARCH 29, 2022

Source: [link] Off-the-Shelf ERP Systems Too Limited Due to our vertically-integrated business model, our supply chain is longer than most clothing makers. We tried many off-the-shelf ERP systems to manage our inventory end-to-end but nothing proved up to the task. and help them avoid the hassle and cost of import taxes.

Systems 52

Systems MySQL Management Retail 52

Data Engineering Podcast

DECEMBER 26, 2021

Zhamak Dehghani introduced the concepts behind this architectural patterns in 2019, and since then it has been gaining popularity with many companies adopting some version of it in their systems. How has your view of the principles of the data mesh changed since our conversation in July of 2019?

BI 130

BI Data Warehouse Data Engineer Data Engineering 130

The Pragmatic Engineer

NOVEMBER 9, 2023

In 2019, Javice was featured on the Forbes “30 under 30” finance list , suggesting she was a high-flying founder: How Charlie Javice appeared on the Forbes 30 under 30 list in 2019. Frank: a software engineer refuses to fake customer data Frank was a student loan startup founded by Charlie Javice in 2016.

Software Engineering 222

Software Engineering Software Engineer Engineering Coding 222

The Pragmatic Engineer

APRIL 13, 2023

Source: Dealroom Seed investments have dropped since 2021, but in 2022 were around the same level as in 2020 – and well above 2019. But what about seed rounds in Europe, typically of $1-4M by check size? Seed investments in Europe. Zooming out, how have all investment rounds stacked up against previous years?

Finance 189

Finance Media Software Engineering Software Engineer 189

The Pragmatic Engineer

NOVEMBER 21, 2023

If you had a continuous deployment system up and running around 2010, you were ahead of the pack: but today it’s considered strange if your team would not have this for things like web applications.  We dabbled in network engineering, database management, and system administration. and hand-rolled C -code.

Engineering 297

Engineering Bytes Cloud Computing AWS 297

Knowledge Hut

APRIL 25, 2024

Cybersecurity involves protecting sensitive information and critical systems from digital attacks. A cybersecurity measure is designed to combat threats against networked systems and applications, regardless of whether they originate internally or externally. Published : June 4, 2019 by PublicAffairs 8. What is Cybersecurity?

Algorithm 98

Algorithm Manufacturing Certification Media 98

The Pragmatic Engineer

MARCH 19, 2024

When we looked at GitHub Copilot alternatives , all were launched at least a year after GitHub Copilot’s 2021 launch except Tabnine, launched in 2019. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineering 271

Software Engineering Software Engineer Programming Language Media 271

Cloudera

DECEMBER 1, 2023

Launched in 2019, this strategy aims to position the US as a leader in AI research, development, and deployment. A breach or compromise of AI systems can have severe consequences, potentially compromising sensitive citizen data or even disrupting critical services. million), among others.

Building 109

Building Government Transportation Data Governance 109

The Pragmatic Engineer

APRIL 6, 2023

For AI,  we’ve built a system to efficiently use GPT-4 for this purpose, including auto-crafting prompts and performing pre and post-processing. Our system is using purely Serverless to process the data. We use React on the frontend, Node.js on the backend, and Postgres for database storage.

Software Engineering 190

Software Engineering Software Engineer Datasets Database 190

Jesse Anderson

JANUARY 9, 2023

In 2019, Alibaba bought Ververica. This comparison seems like a clear point that Flink will be the system of choice. Streaming systems are already difficult enough and adding more complexity to the choice with lead to analysis paralysis. That’s because it was recently founded, but that doesn’t mean it wasn’t formidable.

Kafka 147

Kafka Coding Technology SQL 147

LinkedIn Engineering

OCTOBER 19, 2023

Over time, LinkedIn's engineering team expanded the stream processing ecosystem with more proprietary tools like Brooklin , facilitating data streaming across multiple stores and messaging systems, and Venice , serving as a storage system for ingesting batch and stream processing job outputs, among others.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Scribd Technology

FEBRUARY 4, 2024

Technical Debt in Machine Learning Originally a software engineering concept, Technical debt is also relevant to Machine Learning Systems infact the landmark google paper suggest that ML systems have the propensity to easily gain this technical debt. This paper argues it is dangerous to think of these quick wins as coming for free.

Machine Learning 40

Machine Learning Software Engineering Software Engineer AWS 40

Knowledge Hut

NOVEMBER 7, 2023

With effect from Feb 2019, renewal would require 20 Scrum educational units(earned in the last 2 years only) and a renewal fee of USD 100 Price 200 USD 500 USD When will you receive the certification? Starting Feb 2019, renewal would require 20 Scrum educational units(earned in the last 2 years only) and a renewal fee of USD 100 3.

Certification 98

Certification Education Recruitment Project 98

Monte Carlo

AUGUST 13, 2024

From the first mention of “ data observability ” back in 2019 to today, data observability has evolved dramatically—from data stack nice-to-have to a “must-have” solution for enterprise companies. Comparing data quality vs data observability According to Gartner, static event based monitoring isn’t sufficient for complex data systems.

Data 52

Data Data Warehouse Data Pipeline Data Architecture 52

The Pragmatic Engineer

MAY 11, 2023

Datadog is a leading observability tooling provider which went public in 2019, with a current market cap of $28B. A very popular open-source solution for systems and services monitoring. A fast and open-source column-oriented database management system, which is a popular choice for log management.

AWS 316

AWS Software Engineering Software Engineer Google Cloud 316

Cloudera

AUGUST 12, 2021

A 2020 retention report by the Work Institute revealed that over 42 million employees in the US left their jobs voluntarily in 2019, and this trend appeared to be increasing. A 2019 HBR article mentioned how organizational decisions backed by data have instilled more confidence and reduced risk. Risk Management.

Manufacturing 111

Manufacturing Insurance Consulting Education 111

Knowledge Hut

JANUARY 30, 2024

The current version of ITIL ® , i.e., ITIL ® V3 is being eased out slowly to make way for ITIL ® V4 which has been launched in February of 2019 by Axelos. The following chart illustrates the current ITIL ® credit system: Sr. ITIL ® V3 certifications also showed a person's level of skill in ITIL ® best practices.

Certification 52

Certification Designing Management Systems 52

Monte Carlo

AUGUST 10, 2023

Editor’s Note : So much has happened since we first published this post and created the data observability category and Monte Carlo in 2019. Data engineering teams needed similar processes and tools to monitor their ETL (or ELT) pipelines and prevent data downtime across their data systems. What is Data observability?

Data Pipeline 98

Data Pipeline Software Engineering Software Engineer Machine Learning 98

Confluent

APRIL 3, 2019

END AS DEPARTMENT, PRODUCT FROM PRODUCTS; ksql> DESCRIBE PRODUCTS_ENRICHED; Name : PRODUCTS_ENRICHED Field | Type - ROWTIME | BIGINT (system) ROWKEY | VARCHAR(STRING) (system) SKU | VARCHAR(STRING) DEPARTMENT | VARCHAR(STRING) PRODUCT | VARCHAR(STRING). WHEN SKU LIKE 'F%' THEN 'Food'. ELSE 'Unknown'. KSQL processing log.

Food 96

Food Kafka Bytes Data Cleanse 96

Zalando Engineering

JANUARY 30, 2023

We consolidated our incident playbooks as part of preparation for Cyber Week in 2019. Our Incident Playbooks cover emergency procedures to initiate in case a certain set of conditions is met, for example when one of our systems is overloaded and the existing resiliency measures (e.g. Incident Playbooks - where are we now?

Management 55

Management Metadata Software Engineering Software Engineer 55

Engineering at Meta

OCTOBER 24, 2023

As an example, we looked at Moments , the photo sharing app Meta launched in 2015 and eventually shut down in 2019, and how SCARF can help with the deprecation process through its workflow management capabilities. It leverages this analysis to submit change requests to remove this code from our systems.

Coding 133

Coding Programming Language Python MySQL 133

U-Next

FEBRUARY 26, 2023

Today it’s one of the largest internet companies in the world, with annual revenue of over $160 billion (2019). The company produces operating systems for multiple platforms, including personal computers (PCs), server computers, and mobile devices such as smartphones and tablets. Average Salary per annum: INR 34.2

Data Science 98

Data Science Machine Learning Consulting Data Mining 98

The Pragmatic Engineer

MAY 1, 2024

When we looked at GitHub Copilot alternatives , all were launched at least a year after GitHub Copilot’s 2021 launch except Tabnine, launched in 2019. In an amusing twist, a few years ago, demand for COBOL developers reportedly soared as there are still critical banking and insurance systems using this now-ancient language.

Software Engineering 196

Software Engineering Software Engineer Programming Language Media 196

Towards Data Science

FEBRUARY 15, 2023

The Data Lake architecture was proposed in a period of great growth in the data volume, especially in non-structured and semi-structured data, when traditional Data Warehouse systems start to become incapable of dealing with this demand. Let’s add the readings from 2019. Legend says, that this didn’t go well. The data became useless.

Data Lake 76

Data Lake Data Warehouse Architecture Hadoop 76

LinkedIn Engineering

APRIL 18, 2023

Minion (an agent on host) sees jobs and results by subscribing to events published on the event bus by master service, It uses ZMQ (ZeroMQ) to achieve high-speed, asynchronous communication between connected systems. Targeted minions execute the job on the host and return to master.

MySQL 103

MySQL Python Bytes Kafka 103

RandomTrees

SEPTEMBER 10, 2024

AI enhances predictive maintenance in several ways: Data Analysis: In real-time modes, AI processes large volumes of information while detecting any patterns or anomalies that could indicate an impending failure ahead of traditional monitoring systems. An industry should check the compatibility between its current systems and AIs.

Transportation 52

Transportation Manufacturing Machine Learning Algorithm 52