François Nguyen

MARCH 22, 2021

Just an illustration – not the truth and you certainly can do it with other technologies. There are certainly many other ways to do the same with another technologies. More than the technology chosen, it is more interesting to talk about the spirit behind these choices. How do we build data products ?

Technology 130

Technology Architecture Google Cloud Metadata 130

Workfall

SEPTEMBER 26, 2023

Reading Time: 9 minutes In this blog, we will cover: What are Server-Sent Events? Why Stream Data Using Server-Sent Events (SSE)? Hands-On Conclusion What are Server-Sent Events? These events can carry information like notifications, updates, or alerts. This makes it accessible to a wider range of developers and projects.

Python 85

Python Bytes Coding Project 85

Data Engineering Podcast

AUGUST 10, 2020

Summary Event based data is a rich source of information for analytics, unless none of the event structures are consistent. The team at Iteratively are building a platform to manage the end to end flow of collaboration around what events are needed, how to structure the attributes, and how they are captured.

Data Collection 100

Data Collection Data Engineer Data Engineering Education 100

Striim

NOVEMBER 8, 2023

Data Mesh is revolutionizing event streaming architecture by enabling organizations to quickly and easily integrate real-time data, streaming analytics, and more. By exploring the benefits of using Data Mesh for your event streaming architecture, this article will help you decide if it’s the right solution for your organization.

Architecture 52

Architecture Generalist Government Datasets 52

Scott Logic

JUNE 29, 2023

Every year on Global Accessibility Awareness Day , people come together to raise awareness about the barriers many users still face in the digital world. This May, we, Doro Hinrichs and Oded Sharon, attended an accessibility panel discussion and workshop with UserVision on Creating Accessible Digital Experiences.

Accessibility 52

Accessibility Accessible Consulting Designing 52

Robinhood

NOVEMBER 13, 2024

Robinhood Crypto’s commitment to expanding access and maintaining a safe, easy-to-use platform deepens with the addition of 4 digital assets Today, Robinhood Crypto announced the addition of Solana (SOL), Pepe (PEPE), Cardano (ADA) & XRP (XRP) to its U.S. platform, bringing the total number of cryptocurrencies available for trading to 19.

Insurance 140

Insurance Accessible Accessibility Project 140

Confluent

FEBRUARY 27, 2019

FaaS functions only solve the compute part, but where is data stored and managed, and how is it accessed? What is more, as the world adopts the event-driven streaming architecture, how does it fit with serverless? The key to event-first systems design is understanding that a series of events captures behavior. Next Steps.

Kafka 109

Kafka AWS Architecture Cloud 109

Confluent

MAY 9, 2019

Event-first thinking enables us to build a new atomic unit: the event. Four pillars of event streaming. Pillar 4 – Operational plane: Event logging, DLQs and automation. To read the other articles in this series, see: Journey to Event Driven – Part 1: Why Event-First Thinking Changes Everything.

Kafka 94

Kafka Pipeline-centric Architecture Database-centric 94

Data Engineering Podcast

FEBRUARY 18, 2024

Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Scott Logic

APRIL 22, 2024

In my previous blog post I looked at various technologies for sending data asynchronously between services including RabbitMQ, Kafka, AWS EventBridge. I’ve coloured the data entities according to their types and we see there’s a few different patterns like events and state which we’ll discuss in a moment.

AWS 52

AWS Metadata Systems Kafka 52

Knowledge Hut

NOVEMBER 19, 2023

With advances in technology, wearable devices do provide some trace of your health. Importance of Data Science in IoT IoT and Data Science are amongst the most defining technologies of our age. Challenges of Data Science for IoT Any great technology brings along its own unique set of challenges. Here is the broad.

Data Science 52

Data Science Technology Machine Learning Big Data 52

Confluent

JUNE 7, 2019

Access to the data lake and raw data streams is self-provisioned which allows us to work in parallel, and to scale to support multiple protocols (e.g., On the event streaming side, we offer reliable low-latency data streams for financial applications based on Kafka Streams. Why does on-chain data matter?

Accessibility 93

Accessibility Accessible Kafka Scala 93

Robinhood

OCTOBER 21, 2024

Historically, UK retail investors have had challenges accessing features like margin investing that provide other ways to help maximise their investments. At Robinhood we understand that investors want access to expand and diversify their portfolios at industry leading rates, in an amazing user experience.”

Portfolio 99

Portfolio Insurance Retail Banking 99

Confluent

FEBRUARY 13, 2019

Part 1 of this series discussed why you need to embrace event-first thinking, while this article builds a rationale for different styles of event-driven architectures and compares and contrasts scaling, persistence and runtime models. Event-driven architecture. Event-driven, reactive architecture. Being event first.

Architecture 92

Architecture Programming Kafka Database-centric 92

Cloudera

FEBRUARY 4, 2021

I am pleased to announce that Cloudera was just named the Risk Data Repository and Data Management Product of the Year in the Risk Markets Technology Awards 2021. . SDX enables safe and compliant self-service access to data and analytics. They need a comprehensive data and analytics platform to model risk exposures on-demand.

Technology 86

Technology Data Management Management Insurance 86

Engineering at Meta

OCTOBER 22, 2024

Traditionally, WhatsApp has lacked the ability to store your contact list in a way that can be easily and automatically restored in the event you lose it. Contact names are stored encrypted within WhatsApp, and we’ve built this with additional, robust protections by using IPLS to deter access to contacts to anyone except the user.

Consulting 92

Consulting Accessible Accessibility Technology 92

Data Engineering Podcast

MARCH 3, 2024

Summary Artificial intelligence technologies promise to revolutionize business and produce new sources of value. Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Visit dataengineeringpodcast.com/data-council and use code dataengpod20 to register today!

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

NOVEMBER 26, 2023

Summary Building a data platform that is enjoyable and accessible for all of its end users is a substantial challenge. Developing event-driven pipelines is going to be a lot easier - Meet Functions! Memphis Logo]([link] Developing event-driven pipelines is going to be a lot easier - Meet Functions!

Architecture 147

Architecture Data Lake High Quality Data SQL 147

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. In the event of these different cluster errors, what are the strategies for mitigating and recovering from those failures? Operating it at scale, however, is notoriously challenging.

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Data Engineering Podcast

MARCH 18, 2023

Summary As with all aspects of technology, security is a critical element of data applications, and the different controls can be at cross purposes with productivity. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Join in with the event for the global data community, Data Council Austin.

Data Security 130

Data Security Machine Learning Data Science Metadata 130

Snowflake

JUNE 28, 2023

External Network Access (PrPr) – Allows users to seamlessly connect to external endpoints from their Snowpark code (UDFs/UDTFs and Stored procedures) while maintaining high security and governance. Python Tasks API (PrPr Soon) – Provides first class Python APIs for creating and managing Snowflake Tasks/DAGs.

Python 52

Python Accessibility Accessible Pipeline-centric 52

Data Engineering Podcast

MARCH 17, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Contact Info LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When is Datafold/data-diff the wrong choice? Data Council : ![Data

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

MARCH 10, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Contact Info LinkedIn Twitter Alex's Article on Dremio's Blog Alex's Substack Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today?

Data Lake 147

Data Lake High Quality Data Data Pipeline Architecture 147

Netflix Tech

SEPTEMBER 10, 2024

During this event, we generate a timestamp and store it in an eBPF hash map using the process ID as the key. This feature enables access to a wealth of information stored about a process. To safely access this RCU-protected information, we can leverage kfuncs in eBPF.

Utilities 98

Utilities Coding Programming Java 98

The Pragmatic Engineer

NOVEMBER 21, 2023

Joshua is currently VP of Product & Strategy at VMware, a cloud computing and virtualization technology company. Joshua also writes an excellent Substack newsletter about how to design products which customers love, how to operate live services at scale, grow and optimize your technology orgs, and the history of the tech industry.

Engineering 297

Engineering Bytes Cloud Computing AWS 297

Data Engineering Podcast

APRIL 16, 2023

As the capabilities of these systems has improved and become more accessible, the target of what self-serve means changes. Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Cloudera

MARCH 6, 2024

As we enter into a new month, the Cloudera team is getting ready to head off to the Gartner Data & Analytics Summit in Orlando, Florida for one of the most important events of the year for Chief Data Analytics Officers (CDAOs) and the field of data and analytics. Add a Human To The Loop: An Introduction to RLHF & DPO.

Data Analytics 108

Data Analytics Data Technology Data Engineer 108

Data Engineering Podcast

MARCH 24, 2024

Contact Info Twitter LinkedIn Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? What do you have planned for the future of Dagster/Dagster Cloud/Dagster+? Closing Announcements Thank you for listening! Don't forget to check out our other shows.

Data Lake 162

Data Lake High Quality Data Hadoop Data Pipeline 162

Knowledge Hut

DECEMBER 22, 2023

Voice Search Benefits: Improved User Experience Accessibility Hands-free Interaction Faster Search Results Examples: Integrating voice-enabled search boxes or chatbots on websites to allow users to perform voice-based searches. Implementing voice recognition technology and APIs to accurately transcribe and process voice inputs.

Entertainment 105

Entertainment Machine Learning Utilities Google Cloud 105

Cloudera

MAY 10, 2024

Building an open data lakehouse with Iceberg delivers significant benefits increasing self-service access, ease of use, flexibility, and delivering unified security and governance for all data. From data pipelines into Iceberg to data governance, the event will hit on a broad range of topics surrounding Iceberg.

Government 102

Government Data Governance Data Pipeline Big Data 102

Knowledge Hut

MAY 3, 2024

Dean Wampler (Renowned author of many big data technology-related books) Dean Wampler makes an important point in one of his webinars. And hence, there is a need to understand the concept of “stream processing “and the technology behind it. Kafka offers better fault tolerance because of its event-driven processing.

Kafka 98

Kafka Scala Java Amazon Web Services 98

Robinhood

OCTOBER 10, 2024

When Robinhood was founded, we set out to build a platform that gives everyone access to the financial markets. The new visuals are also being used in the marketing for Robinhood’s first-ever customer-focused conference: HOOD Summit 2024 , a three-day event (Oct. RCT), is a financial technology company, not a bank. HOOD Summit.

Banking 122

Banking Retail Designing Finance 122

Snowflake

OCTOBER 28, 2024

The stage is set for a new era in marketing, and marketers have never had so much data and technology at their fingertips. Snowflake is here to help marketers evolve and accelerate their marketing impact with our third annual Modern Marketing Data Stack report and global virtual event.

Food 81

Food Media Retail Business Intelligence 81

Knowledge Hut

JULY 2, 2024

So, what does the future hold for this transformative technology? Look for the Best Cloud Computing Courses Online to gain expertise in the tools, technologies, and Cloud computing trends. With cloud computing, businesses can now access powerful computer resources without having to invest in their own hardware.

Cloud Computing 98

Cloud Computing Cloud Healthcare Education 98

Robinhood

OCTOBER 16, 2024

We’re giving customers access to sophisticated advanced trading tools designed for active traders who believe that intuitive, beautiful products can be a powerful advantage while trading. Enjoy low commissions : Access commissions as low as $0.50 For more information about HOOD Summit visit go.robinhood.com/events.

Electronics 75

Electronics Consulting Accessible Accessibility 75

Cloudera

APRIL 18, 2024

With the arrival of the latest AI-powered technologies like large language models (LLMs) and generative AI (GenAI), there’s a vast amount of opportunities for innovation, growth, and improved business outcomes right around the corner. All of that technology, though, depends on data to be successful.

Metadata 109

Metadata Government Data Governance Data 109

Knowledge Hut

MAY 2, 2024

From the most technologically savvy person working in leading digital platform companies like Google or Facebook to someone who is just a smartphone user, there are very few who have not been impacted by artificial intelligence or machine learning in some form or the other; through social media, smart banking, healthcare or even Uber.

Machine Learning 98

Machine Learning Algorithm Datasets Python 98