databricks

JULY 23, 2024

In this blog, we are excited to share Databricks's journey in migrating to Unity Catalog for enhanced data governance. We'll discuss our high-level strategy and the tools we developed to facilitate the migration. Our goal is to highlight the benefits of Unity Catalog and make you feel confident about transitioning to it.

Government 133

Government Data Governance IT Data 133

KDnuggets

APRIL 10, 2024

Learn Python through tutorials, blogs, books, project work, and exercises. Access all of it on GitHub for free and join a supportive open-source community.

Python 148

Python Accessible Accessibility Project 148

Waitingforcode

JANUARY 17, 2024

I only slightly blogged about Change Data Feed but completely missed the fundamentals. Hopefully, this and next blog posts will change this! Even though I'm into streaming these days, I haven't really covered streaming in Delta Lake yet.

Data 130

Data 130

databricks

FEBRUARY 29, 2024

Special thanks to Phillip Jones, Senior Product Manager, and Harshal Brahmbhatt, Systems Engineer from Cloudflare for their contributions to this blog. Organizations across.

Engineering 125

Engineering Systems Management 125

Confluent

MAY 1, 2024

In this blog, learn how Freight clusters can save you up to 90% at GBps+ scale. Confluent Cloud Freight clusters are now available in Early Access.

Cloud 145

Cloud Accessible Accessibility 145

ArcGIS

MAY 7, 2024

Read our blog to learn more. Discover the exciting new features of ArcGIS Pro 3.3. From water flow modeling to direct PDF support, this release has it all.

IT 144

IT 144

databricks

AUGUST 19, 2024

This blog covers the basics you need to successfully onboard your Genie and maximize the benefits. Deploying an AI/BI Genie is like hiring a new data analyst.

BI 122

BI Data 122

Robinhood

JUNE 6, 2024

Cautionary Note Regarding Forward-Looking Statements This blog post contains forward-looking statements, including with respect to our agreement to acquire Bitstamp and our current expectations with respect to final deal consideration and timing. Barclays Capital Inc. served as exclusive financial advisor to Robinhood.

Retail 129

Retail Systems Process Management 129

KDnuggets

DECEMBER 1, 2023

The blog covers machine learning courses, bootcamps, books, tools, interview questions, cheat sheets, MLOps platforms, and more to master ML and secure your dream job.

Machine Learning 154

Machine Learning 154

The Pragmatic Engineer

MAY 12, 2023

An explanation on why such a short blog post: I wanted to reply in a tweet, but, apparently, Twitter does not allow posting more than a few links in a reply. OpsGenie is clearly more critical of a system than the ones like JIRA or Confluence, but it is not treated with priority within the Atlassian stack, at least now it seems like it.

Systems 231

Systems Management Engineering IT 231

KDnuggets

FEBRUARY 1, 2024

This blog covers non-technical, Python, SQL, statistics, data analysis, and machine learning questions. Learn about the most common questions asked during data science interviews.

Data Science 135

Data Science Machine Learning Data Analysis SQL 135

Confluent

MARCH 19, 2024

Read more in our blog post. Seamlessly integrate Apache Kafka data into your lakehouse as Apache Iceberg tables, bridging the operational and analytical divide, with Tableflow.

Kafka 133

Kafka Data 133

Jesse Anderson

NOVEMBER 14, 2023

A Guest Post by Ole Olesen-Bagneux In this blog post I would like to describe a new data team, that I call ‘the data discovery team’. And that is what the data discovery team that I propose in this blog post should work on: searching for data. In an enterprise data reality, searching for data is a bit of a hassle.

Metadata 147

Metadata Data Science Big Data Data 147

Tweag

NOVEMBER 20, 2024

Two years ago I wrote a blog post to announce that the GHC wasm backend had been merged upstream. I’ve been too lazy to write another blog post about the project since then, but rest assured, the project hasn’t stagnated. is widely taught, there’s really no tutorial nor blog post to teach me about assembly syntax for wasm!

Coding 137

Coding Programming Project Process 137

Waitingforcode

AUGUST 1, 2024

Welcome to the second blog post dedicated to the previous Data+AI Summit. This time I'm going to share with you a summary of Apache Spark talks.

Data 130

Data 130

Waitingforcode

JULY 10, 2024

Welcome to the first Data+AI Summit 2024 retrospective blog post. I'm opening the series with the topic close to my heart at the moment, stream processing!

Data 130

Data Process 130

Waitingforcode

FEBRUARY 6, 2024

The previous blog from the series we discovered streaming reader. However, an end-to-end streaming Delta Lake pipeline also requires a writer which will be our focus today.

130

130

databricks

AUGUST 20, 2024

Special thanks to Kevin Glover, Martin Ko, Kuber Sharma and the team at Tableau for their valuable insights and contributions to this blog.

110

110

Waitingforcode

JANUARY 2, 2024

This is one of my favorite blog posts, the yearly retrospective. Every year I summarize what happened in the past 12 months and share with you my future plans. It's time for the 2023 Edition!

IT 130

IT 130

Waitingforcode

MARCH 5, 2024

I'm writing this unexpected blog post because I got stuck with watermarks and checkpoints and felt that I was missing some basics. Even though this introduction is a bit negative, the exploration for the data reading enabled my other discoveries.

Data 130

Data 130

Waitingforcode

MAY 9, 2024

Well, not really but I let you discover why in this blog post. While I have been exploring arbitrary stateful processing, hence the mapGroupsWithState among others, I mistakenly created a batch DataFrame and applied the mapping function on top of it. Turns out, it worked!

Process 130

Process IT 130

Waitingforcode

MAY 7, 2024

I wrote a blog post about OutputModes 6 (yes!) years ago and after reading it a few times, I realized it was not good enough to be a quick refresher. For that reason you can read about OutputModes for the second time here. Hopefully, this one will be a good try!

IT 130

IT 130

Waitingforcode

JUNE 24, 2024

I'm writing this blog post to remember them and why not, share the knowledge with you! Last May I gave a talk about stream processing fallacies at Infoshare in Gdansk. Besides this speaking experience, I was also - and maybe among others - an attendee who enjoyed several talks in software and data engineering areas.

Data Engineering 130

Data Engineering Data Engineer Engineering Process 130

Christophe Blefari

MARCH 8, 2024

I mean, there is a big difference between podcast for instance and news blogging like I'm doing. Architecture I said it, while being a new feature to the blog this is as well an educational projet I can use to showcase technologies. The main part of the blog is just a bunch of Handlebars templates connected to Ghost Content API.

Data 130

Data Algorithm Database Education 130

databricks

AUGUST 12, 2024

The blog explores data streams from NASA satellites using Apache Kafka and Databricks. It demonstrates ingestion and transformation with Delta Live Tables in SQL and AI/BI-powered analysis of supernova events.

BI 108

BI Kafka SQL Data 108

Tweag

MARCH 6, 2024

Three years ago, a blog post introduced destination-passing style (DPS) programming in Haskell, focusing on array processing, for which the API was made safe thanks to Linear Haskell. The present blog post is mostly based on my recent paper Destination-passing style programming: a Haskell implementation , published at JFLA 2024.

Programming 126

Programming Data Programming Language Coding 126

KDnuggets

DECEMBER 7, 2023

This blog post explores NotebookLM, its functionality, limitations, and advanced features essential for researchers and scientists.

Data Science 135

Data Science Data IT 135

Rockset

JUNE 21, 2024

Read more: OpenAI’s blog post FAQs for Rockset customers Their support and belief in us have been the bedrock of our success. We look forward to continuing what we’ve started at Rockset and supporting OpenAI’s mission of building safe, beneficial AGI.

Database 145

Database Cloud Accessible Accessibility 145

Zalando Engineering

NOVEMBER 8, 2023

Introduction This blog post describes a recent contribution from Zalando to the Postgres JDBC driver to address a long-standing issue with the driver’s integration with Postgres’ logical replication that resulted in runaway Write-Ahead Log (WAL) growth. However as you may imagine, this blog post concerns a path that is anything but happy.

PostgreSQL 138

PostgreSQL Java Database Bytes 138

Data Engineering Weekly

JULY 28, 2024

The blog is an excellent summarization of the common patterns emerging in GenAI platforms. The blog Prompt Engineering for a Better SQL Code Generation With LLMs is a pretty good guide on applying prompt engineering to improve productivity. Swiggy recently wrote about its internal platform, Hermes, a text-to-SQL solution.

Data Engineering 110

Data Engineering Data Engineer Engineering Database-centric 110

Christophe Blefari

JANUARY 7, 2024

What 2023 brought: Followers — I doubled in followers on my 3 main platforms: I reached 4000 people on the blog, 8000 on LinkedIn and almost 600 on Twitter (even if I don't post that much there). The blog — 46 articles published in 2023, this is way less than in 2022 but it's ok. It's time.

Data 130

Data SQL Python Data Engineering 130

KDnuggets

NOVEMBER 7, 2024

Here’s a list of free courses, guides, and blogs that make it easy to start learning and stay updated. Curious about LLM agents?

IT 114

IT 114

databricks

SEPTEMBER 18, 2024

In this blog, we'll explain how you can leverage our platform's security features to establish a robust defense-in-depth posture that protects your data and AI assets from risks.

Data 101

Data 101

Data Engineering Podcast

APRIL 21, 2024

Contact Info LinkedIn Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? Contact Info LinkedIn Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? When is Shortwave the wrong choice?

Data Lake 182

Data Lake High Quality Data Data Pipeline Machine Learning 182

ArcGIS

DECEMBER 3, 2024

This blog shows usability and accessibility improvements introduced in the Versioning contextual tab with the release of ArcGIS Pro 3.4.

Accessible 99

Accessible Accessibility Data Management Management 99

databricks

AUGUST 16, 2024

This blog was written in collaboration with Gordon Strodel, Director, Data Strategy & Analytics Capability, in addition to Abhinav Batra, Associate Principal, Enterprise.

Building 111

Building Data Healthcare 111

databricks

JUNE 6, 2024

This blog is authored by Bhaskar Palit , Senior Director, Data & Analytics, PepsiCo, and Sudipta Das , Data Architect Senior Manager, PepsiCo.

Data Architect 110

Data Architect Data Management 110