Netflix Tech

FEBRUARY 18, 2022

To this end, we developed a Rapid Event Notification System (RENO) to support use cases that require server initiated communication with devices in a scalable and extensible manner. In this blog post, we will give an overview of the Rapid Event Notification System at Netflix and share some of the learnings we gained along the way.

Systems 133

Systems Architecture Portfolio Designing 133

Confluent

AUGUST 2, 2024

BT Group's Smart Event Mesh - centralized event streaming with decentralized customer experience, automation, and a foundation—all built on Confluent.

85

85

Knowledge Hut

APRIL 25, 2023

In this article, we will look at how a scrum master facilitates events such as daily scrum meetings, sprint planning, sprint review, and sprint retrospective meetings. They lead the team through the Scrum process, making sure that everyone is involved and that all events are carried out successfully.

Utilities 98

Utilities Project Certification Process 98

Snowflake

OCTOBER 30, 2023

We are excited to announce the general availability of Snowflake Event Tables for logging and tracing, an essential feature to boost application observability and supportability for Snowflake developers. Developers can then query Event Tables to troubleshoot their applications or gain insights into performance and code behavior.

Java 96

Java Scala Hadoop Data Ingestion 96

Confluent

JUNE 28, 2023

Get an introduction into the world of events and event-driven architecture in Apache Kafka. Learn what events are and the role they play in event design, event streaming, and event-driven design.

Kafka 111

Kafka Architecture Designing 111

Snowflake

SEPTEMBER 12, 2023

Data Cloud Industry Day 2023 is a free virtual event on September 28, 2023, dedicated to what’s possible for you and your industry in the world of data. The event will feature industry-specific sessions hosted by Snowflake’s industry leaders along with exciting customer guest speakers. Attendance at this event is totally FREE.

Cloud 92

Cloud Manufacturing Retail Healthcare 92

LinkedIn Engineering

OCTOBER 19, 2023

Authors: Bingfeng Xia and Xinyu Liu Background At LinkedIn, Apache Beam plays a pivotal role in stream processing infrastructures that process over 4 trillion events daily through more than 3,000 pipelines across multiple production data centers.

Process 119

Process Lambda Architecture Kafka Machine Learning 119

Confluent

NOVEMBER 30, 2022

What is stream processing, or complex event processing (CEP), and how does it work? Learn about real-time data and event stream analytics in this tutorial.

Process 126

Process Data IT 126

Eventbrite Engineering

MARCH 12, 2024

Ideally, each such change would improve the quality of results, which can be measured using engagement … Continue reading "Automating Relevance Tuning for Event Search" The post Automating Relevance Tuning for Event Search appeared first on Engineering Blog.

Algorithm 52

Algorithm Engineering Process Machine Learning 52

Knowledge Hut

FEBRUARY 29, 2024

Event handling essentially allows the user to interact with a webpage and do something specific when a certain event like a click or a hover happens. When the user interacts with the application, events are fired, for example, mouseover, key press, change event, and so on. React events are written in camelCase.

Python 52

Python Coding Certification IT 52

Knowledge Hut

JUNE 4, 2024

If you've always wanted to learn how to use event binding in Angular, you've come to the right place. This article will discuss Angular's event binding and how to apply it to our Angular project. Events are triggered after these actions are completed. How Does Event Binding Works in Angular ?

Metadata 52

Metadata Coding Project Python 52

Snowflake

OCTOBER 9, 2023

Easily collect and store digital events directly to create a complete composable customer data platform (CDP) Marketers are increasingly leveraging the Snowflake Data Cloud as the foundation for all of their customer data analytics and activation.

Cloud 99

Cloud Building SQL Data 99

Lyft Engineering

MARCH 27, 2023

However, at Lyft we have come to realize that load testing in production is a powerful tool to prepare systems for unexpected bursty traffic and peak events. Lyft must operate seamlessly even when demand spikes It’s imperative for Lyft to be highly available during peak events like Halloween and New Year’s Eve.

Coding 132

Coding Database Systems Engineering 132

Confluent

SEPTEMBER 9, 2021

I’ve always found event sourcing to be fascinating. We spend so much of our lives as developers saving data in database tables—doing this in a completely different way seems almost […].

Database 91

Database Data Process 91

Cloudyard

FEBRUARY 27, 2024

This blog post showcases a novel approach combining Snowflake’s Event Logging and Dynamic Tables to automate the creation and population of dynamic tables based on Copy operations. Event-Driven Logging The journey begins with an innovative approach to log and monitor data copy operations.

Data Warehouse 52

Data Warehouse Utilities Architecture Data Management 52

dbt Developer Hub

NOVEMBER 3, 2022

Let’s discuss how to convert events from an event-driven microservice architecture into relational tables in a warehouse like Snowflake. So our solution was to start using an intentional contract: Events. What are Events? Events are facts about what happened within your service.

Kafka 52

Kafka ETL Tools BI Database 52

Cloudyard

JULY 16, 2023

Read Time: 2 Minute, 13 Second During the last post we discussed about the Event tables and how these are used for Error logging in your process. The UDTF was responsible of parsing JSON data in a tabular format and identify any erroneous records and log into an Event table. Event tables.

Metadata 52

Metadata Python Utilities Coding 52

Cloudyard

JULY 20, 2023

Read Time: 1 Minute, 38 Second During the previous post we discussed the usage of EVENT table with Python and Javascript procedure. In continuation of the same we will explore how we can leverage the EVENT tables in SQL scripting. We will use the EVENT tables to log the error and other details through SQL scripting procedure.

SQL 52

SQL Python Systems Designing 52

Hevo

JUNE 25, 2024

In this article, you will learn about Kafka Debezium, features of Debezium, and how to perform event sourcing using Debezium and Kafka. Today, a combination of Debezium and Kafka is embraced by organizations to record changes in databases and provide information to subscribers (other applications). Prerequisites What is Kafka?

Kafka 52

Kafka Database Data 52

Start Data Engineering

APRIL 4, 2020

One of the most common issues when ingesting and processing user generated events is, how to deal with late arriving events. Some of the general issues that data engineers usually have are “What should be considered the event time?” Yet this topic is not extensively discussed.

Data Engineering 130

Data Engineering Data Engineer Engineering Process 130

Confluent

SEPTEMBER 21, 2022

A deep dive into how microservices work, why it’s the backbone of real-time applications, and how to build event-driven microservices applications with Python and Kafka.

Kafka 98

Kafka Python Building 98

Workfall

SEPTEMBER 26, 2023

Reading Time: 9 minutes In this blog, we will cover: What are Server-Sent Events? Why Stream Data Using Server-Sent Events (SSE)? Hands-On Conclusion What are Server-Sent Events? These events can carry information like notifications, updates, or alerts. What is FastAPI?

Python 85

Python Bytes Coding Project 85

Confluent

FEBRUARY 27, 2019

What is more, as the world adopts the event-driven streaming architecture, how does it fit with serverless? Serverless functions provide a synergistic relationship with event streaming applications; they behave differently with respect to streaming workloads but are both event driven. Event-first FaaS? Event-first FaaS.

Kafka 109

Kafka AWS Architecture Cloud 109

Confluent

JULY 8, 2020

In the article Should You Put Several Event Types in the Same Kafka Topic?, Martin Kleppmann discusses when to combine several event types in the same topic and introduces new […].

Kafka 138

Kafka 138

Confluent

MAY 9, 2019

Event-first thinking enables us to build a new atomic unit: the event. Four pillars of event streaming. Pillar 4 – Operational plane: Event logging, DLQs and automation. To read the other articles in this series, see: Journey to Event Driven – Part 1: Why Event-First Thinking Changes Everything.

Kafka 94

Kafka Pipeline-centric Architecture Database-centric 94

Confluent

NOVEMBER 25, 2020

The event provided an opportunity for participants to learn, build, and showcase […]. As part of this year’s Kafka Summit, the Confluent Community team hosted a community hackathon named Kafkathon 2020.

Kafka 105

Kafka Building 105

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineering Data Engineer Education 100

Confluent

FEBRUARY 8, 2024

Luckily, taking an event-driven approach can make the process more manageable. Struggling to get your GenAI app off the ground? You’re not alone—GenAI apps can be challenging to build. Learn how.

Building 52

Building Process Management 52

Workfall

JUNE 27, 2023

In this blog, we’ll explore how to harness the power of Kafka to streamline event streaming within a microservices architecture and unlock its full potential for building scalable and responsive systems. In the event of server failure, Kafka can autonomously restart itself, ensuring uninterrupted data flow. Let’s get started!

Kafka 75

Kafka Architecture AWS Transportation 75

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. By exploring the benefits of using Data Mesh for your event streaming architecture, this article will help you decide if it’s the right solution for your organization.

Architecture 52

Architecture Generalist Government Datasets 52

Scott Logic

APRIL 22, 2024

I’ve coloured the data entities according to their types and we see there’s a few different patterns like events and state which we’ll discuss in a moment. I’ll use the term message in this blog as a generic term for asynchronous communication that may be state or commands or events.

AWS 52

AWS Metadata Systems Kafka 52

Confluent

FEBRUARY 2, 2021

Since I first started using Apache Kafka® eight years ago, I went from being a student who had just heard about event streaming to contributing to the transformational, company-wide event […].

Kafka 97

Kafka Data Schemas Cloud Data 97

KDnuggets

JUNE 26, 2023

Have you ever wondered how fortune tellers, astrologers, or our well-known Baba Vanga used to predict future events? Or have you ever questioned whether AI and ML have the capabilities to predict future events as Baba Vanga did? For suppose if AI and ML have the capabilities, then up to how extent can it predict?

IT 76

IT 76

Confluent

FEBRUARY 13, 2019

Part 1 of this series discussed why you need to embrace event-first thinking, while this article builds a rationale for different styles of event-driven architectures and compares and contrasts scaling, persistence and runtime models. Event-driven architecture. Event-driven, reactive architecture. Being event first.

Architecture 92

Architecture Programming Kafka Database-centric 92

Cloudyard

JULY 11, 2023

Read Time: 4 Minute, 32 Second In this post, we will explore the utilization of EVENT tables to capture erroneous data. To achieve this, a Python process is employed to process the input feed file, identifying and excluding the flawed records, while simultaneously logging them in an event table. However, Import the below two module.

Python 40

Python Utilities Datasets Data Pipeline 40

Confluent

SEPTEMBER 11, 2023

See how you can leverage a data streaming platform to build event-driven microservices and do stream processing for faster, better customer onboarding.

Cloud 69

Cloud Building Process Data 69