KDnuggets

FEBRUARY 5, 2024

If you are new to generative AI or an expert who wants to learn more, O’Reilly offers a range of resources to kickstart your generative AI journey.

144

144

The Pragmatic Engineer

OCTOBER 18, 2024

And yet, substitute Apple with Automattic, App Store with WordPress.org and Spotify with one of the most popular WordPress plugins: and Automattic’s CEO is accused of orchestrating events similar to above. This event is shameful and unprecedented in the history of open source on the web. Open source theft? Source: X What next?

Government 326

Government Engineering Project AWS 326

Confluent

AUGUST 2, 2024

BT Group's Smart Event Mesh - centralized event streaming with decentralized customer experience, automation, and a foundation—all built on Confluent.

85

85

Confluent

OCTOBER 11, 2024

Learn how to leverage event design to make eventual bad data in your event streams easier to repair, and also what to do when you have a contaminated stream.

Data 72

Data Designing Process 72

Cloudera

NOVEMBER 1, 2024

Over the last few months, Cloudera has been traversing the globe hosting our EVOLVE24 event series. The post Looking Back on Our First Women Leaders in Technology Event appeared first on Cloudera Blog. It has been a time full of excitement, innovative ideas, and connection with our partners and customers.

Technology 97

Technology Recruitment Banking AWS 97

Data Engineering Podcast

FEBRUARY 18, 2024

Join in with the event for the global data community, Data Council Austin. Don't miss out on their only event this year! Data Council Logo]([link] Join us at the event for the global data community, Data Council Austin. Don't miss out on our only event this year! Don't miss out on their only event this year!

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

Waitingforcode

JULY 25, 2023

You certainly know it, the watermark (aka GC Watermark) is responsible for cleaning state store in Apache Spark Structured Streaming. But you may not know that it's not the single time-based condition. There is a different one involved in the stream-to-stream joins.

IT 130

IT 130

Analytics Vidhya

JANUARY 30, 2023

Introduction Azure Functions is a serverless computing service provided by Azure that provides users a platform to write code without having to provision or manage infrastructure in response to a variety of events. Azure functions allow developers […] The post How to Develop Serverless Code Using Azure Functions?

Coding 237

Coding Database Management Process 237

The Pragmatic Engineer

DECEMBER 2, 2023

A year ago, I spent months doing an investigative report on how UK events tech company Pollen had its staff work for free, as it had run out of money but still kept operating. So I looked at other conferences by the same organizer, Dev Events. Three featured speakers listed at DevTernity 2021, 2022 and 2023, and JDKon 2024.

Software Engineer 314

Software Engineer Software Engineering Insurance Coding 314

Start Data Engineering

JUNE 14, 2024

Event-driven pipelines 3.5. Introduction 2. Run Data Pipelines 2.1. Run on codespaces 2.2. Run locally 3. Projects 3.1. Projects from least to most complex 3.2. Batch pipelines 3.3. Stream pipelines 3.4. LLM RAG pipelines 4. Conclusion 1.

Data Engineering 239

Data Engineering Data Engineer Project Engineering 239

Data Engineering Podcast

JUNE 25, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. You can collect, transform, and route data across your entire stack with its event streaming, ETL, and reverse ETL pipelines.

Data Engineering 225

Data Engineering Data Engineer Python Engineering 225

databricks

MAY 31, 2024

With more and more customer interactions moving into the digital domain, it's increasingly important that organizations develop insights into online customer behaviors.

Data Collection 94

Data Collection Data IT 94

Seattle Data Guy

JANUARY 17, 2023

With all the recent data events I have put together I inevitably run into new data engineers who are either finishing up college or looking to transition into a data engineer or data scientist position. In fact I have talked to several newly graduated engineers who are struggling to find work.

Data Engineering 223

Data Engineering Data Engineer Engineering Data 223

Analytics Vidhya

MARCH 7, 2023

Introduction Apache Flume is a tool/service/data ingestion mechanism for gathering, aggregating, and delivering huge amounts of streaming data from diverse sources, such as log files, events, and so on, to centralized data storage. Flume is a tool that is very dependable, distributed, and customizable. einsteinerupload of.

Data Ingestion 216

Data Ingestion Data Storage Hadoop Data 216

Data Engineering Podcast

DECEMBER 24, 2023

Summary Kafka has become a ubiquitous technology, offering a simple method for coordinating events and data across different systems. In the event of these different cluster errors, what are the strategies for mitigating and recovering from those failures? Operating it at scale, however, is notoriously challenging.

Kafka 245

Kafka Data Lake High Quality Data SQL 245

Seattle Data Guy

JANUARY 17, 2023

Our team is putting together an all day event focused on helping answer some… Read more The post What Is The State Of Data Engineering And Infrastructure In 2023 appeared first on Seattle Data Guy. Are Snowflake and Databricks still fighting over total cost of ownership? Is everyone switching to DuckDB?

Data Engineering 211

Data Engineering Data Engineer Engineering Data 211

Confluent

OCTOBER 4, 2024

Bad data causes serious issues and outages for downstream data users. It can be prevented with good data practices, but it must be properly fixed when it does occur.

Data 72

Data IT Process 72

The Pragmatic Engineer

MARCH 3, 2023

I asked Googlers the reason why these events have been canceled and one thing became clear: most of the program managers who worked on the coding competitions were recently let go in Google’s historic job cuts. So knowing these lead up signs, the cancellation of the event is not that surprising, considering the info we had beforehand.

Coding 176

Coding IT Software Engineer Software Engineering 176

The Pragmatic Engineer

APRIL 11, 2024

Confirming this suspicion is Fabrick’s status page that says Fabrick’s tech staff are involved: “We would like to inform you that the event is currently still ongoing, continuous monitoring is in place, and any slowdowns are affecting only the services provided jointly with the Sella group.

Banking 221

Banking Utilities Database Engineering 221

The Pragmatic Engineer

OCTOBER 10, 2024

  The  end of the latest zero interest rate period  (ZIRP) has been one of biggest events in the tech industry in the past 20 years, by slowing down the growth of tech companies, and leading valuations to drop. In 2021, it was valued at $7.5B. Zero percent interest rates have ended: profits matter now. 

Consulting 306

Consulting AWS Engineering Software Engineer 306

Data Engineering Podcast

MARCH 3, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Don't miss out on our only event this year!

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

FEBRUARY 25, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Don't miss out on our only event this year!

Database 162

Database Technology Data Lake High Quality Data 162

The Pragmatic Engineer

NOVEMBER 9, 2023

From to this lawsuit, we get an inside look at how events unfolded inside Frank. Pollen: an engineer told to double charge customers by the CEO Last year, I published my first – and to date only– investigative article on how events tech startup Pollen raised $200M and then collapsed , owing months of wages to staff.

Software Engineer 227

Software Engineer Software Engineering Engineering Coding 227

Zalando Engineering

NOVEMBER 8, 2023

Postgres Logical Replication at Zalando Builders at Zalando have access to a low-code solution that allows them to declare event streams that source from Postgres databases. At the time of writing, there are hundreds of these Postgres-sourced event streams out in the wild at Zalando. Simple, right?

PostgreSQL 138

PostgreSQL Java Database Bytes 138

Data Engineering Podcast

MAY 28, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. You can collect, transform, and route data across your entire stack with its event streaming, ETL, and reverse ETL pipelines.

Data Lake 162

Data Lake Machine Learning Data Warehouse Education 162

Data Engineering Podcast

APRIL 9, 2023

When it was difficult to wire together the event collection, data modeling, reporting, and activation it made sense to buy monolithic products that handled every stage of the customer data lifecycle. You can collect, transform, and route data across your entire stack with its event streaming, ETL, and reverse ETL pipelines.

Data Lake 147

Data Lake Data Warehouse Machine Learning Data 147

The Pragmatic Engineer

MAY 25, 2023

Organize a “Glassdoor review event,” asking employees to leave honest reviews. Engineering leaders and engineers shared some stories: A startup organized a social event at work, and asked employees to show up on time with their laptops. However, there are companies which employ more questionable tactics.

Software Engineer 316

Software Engineer Software Engineering AWS Engineering 316

Snowflake

JUNE 10, 2024

Leveraging Snowflake’s Query History, Event Tables , Alerts and Notifications as the telemetry foundation, Snowflake Trail provides enhanced visibility into data quality, pipelines and applications. Events are all within Snowflake with no need for additional data transfer. Explore logs in your event table easily within Snowsight.

Python 107

Python Java Hadoop Coding 107

Data Engineering Podcast

MAY 21, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. You can collect, transform, and route data across your entire stack with its event streaming, ETL, and reverse ETL pipelines.

Data Lake 162

Data Lake Machine Learning Kafka Data Warehouse 162

Netflix Tech

NOVEMBER 12, 2024

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Datasets 101

Datasets Computer Science Systems Kafka 101

Data Engineering Podcast

MARCH 17, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Don't miss out on our only event this year!

Database 147

Database Data Lake High Quality Data Data Workflow 147

Data Engineering Podcast

MARCH 10, 2024

Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Data Council Logo]([link] Join us at the top event for the global data community, Data Council Austin. Don't miss out on our only event this year! Don't miss out on our only event this year!

Data Lake 147

Data Lake High Quality Data Architecture Data Pipeline 147

Data Engineering Podcast

MAY 14, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. You can collect, transform, and route data across your entire stack with its event streaming, ETL, and reverse ETL pipelines.

Data Lake 147

Data Lake Machine Learning Data Warehouse AWS 147

The Pragmatic Engineer

JULY 20, 2023

Venture funding is on a downward trend , and we seem to be at the start – or the middle – of a “startup purge” event. This news is hot off the press, publicly announced by Postman and by Akita yesterday, and you are among the early ones to hear about this event.

Building 208

Building Programming Language Programming Python 208

Data Engineering Podcast

APRIL 16, 2023

Their SDKs make event streaming from any app or website easy, and their extensive library of integrations enable you to automatically send data to hundreds of downstream tools. You can collect, transform, and route data across your entire stack with its event streaming, ETL, and reverse ETL pipelines.

Business Intelligence 147

Business Intelligence Building Data Lake BI 147

Cloudera

JUNE 17, 2024

In past years, Cloudera employees have hosted events, both in-person and virtually, to celebrate. Last year, our team in Cork, Ireland joined those efforts and hosted its first on-site Pride event. The event proved to be a resounding success, but don’t just take our word for it.

Systems 112

Systems Building IT 112