Waitingforcode

JULY 16, 2024

With this blog I'm starting a follow-up series for my Data+AI Summit 2024 talk. I missed this family of blog posts a lot as the previous DAIS with me as speaker was 4 years ago!

Data 130

Data 130

databricks

OCTOBER 12, 2023

In this blog post, the MosaicML engineering team shares best practices for how to capitalize on popular open source large language models (LLMs).

Engineering 159

Engineering 159

databricks

AUGUST 19, 2024

This blog covers the basics you need to successfully onboard your Genie and maximize the benefits. Deploying an AI/BI Genie is like hiring a new data analyst.

BI 131

BI Data 131

The Pragmatic Engineer

MAY 12, 2023

An explanation on why such a short blog post: I wanted to reply in a tweet, but, apparently, Twitter does not allow posting more than a few links in a reply. OpsGenie is clearly more critical of a system than the ones like JIRA or Confluence, but it is not treated with priority within the Atlassian stack, at least now it seems like it.

Systems 256

Systems Management Engineering IT 256

KDnuggets

APRIL 10, 2024

Learn Python through tutorials, blogs, books, project work, and exercises. Access all of it on GitHub for free and join a supportive open-source community.

Python 150

Python Accessible Accessibility Project 150

databricks

FEBRUARY 29, 2024

Special thanks to Phillip Jones, Senior Product Manager, and Harshal Brahmbhatt, Systems Engineer from Cloudflare for their contributions to this blog. Organizations across.

Engineering 140

Engineering Systems Management 140

Waitingforcode

JANUARY 5, 2025

Even though I was blogging less in the second half of the previous year, the retrospective is still the blog post I'm waiting for each year. Every year I summarize what happened in the past 12 months and share with you my future plans. It's time for the 2024 Edition!

IT 130

IT 130

databricks

JANUARY 18, 2024

This is part 1 of a blog series where we look back at the major areas of progress for Databricks SQL in 2023.

SQL 138

SQL 138

Confluent

MAY 1, 2024

In this blog, learn how Freight clusters can save you up to 90% at GBps+ scale. Confluent Cloud Freight clusters are now available in Early Access.

Cloud 145

Cloud Accessible Accessibility 145

ArcGIS

MAY 7, 2024

Read our blog to learn more. Discover the exciting new features of ArcGIS Pro 3.3. From water flow modeling to direct PDF support, this release has it all.

IT 144

IT 144

Waitingforcode

FEBRUARY 12, 2025

After publishing a release of my blog post about the insertInto trap, I got an intriguing question in the comments. The alternative to the insertInto, the saveAsTable method, doesn't work well on partitioned data in overwrite mode while the insertInto does.

SQL 130

SQL IT Data 130

KDnuggets

DECEMBER 1, 2023

The blog covers machine learning courses, bootcamps, books, tools, interview questions, cheat sheets, MLOps platforms, and more to master ML and secure your dream job.

Machine Learning 157

Machine Learning 157

databricks

SEPTEMBER 18, 2024

In this blog, we'll explain how you can leverage our platform's security features to establish a robust defense-in-depth posture that protects your data and AI assets from risks.

Data 121

Data 121

databricks

AUGUST 20, 2024

Special thanks to Kevin Glover, Martin Ko, Kuber Sharma and the team at Tableau for their valuable insights and contributions to this blog.

116

116

databricks

AUGUST 12, 2024

The blog explores data streams from NASA satellites using Apache Kafka and Databricks. It demonstrates ingestion and transformation with Delta Live Tables in SQL and AI/BI-powered analysis of supernova events.

BI 116

BI Kafka SQL Data 116

Confluent

MARCH 19, 2024

Read more in our blog post. Seamlessly integrate Apache Kafka data into your lakehouse as Apache Iceberg tables, bridging the operational and analytical divide, with Tableflow.

Kafka 133

Kafka Data 133

Jesse Anderson

NOVEMBER 14, 2023

A Guest Post by Ole Olesen-Bagneux In this blog post I would like to describe a new data team, that I call ‘the data discovery team’. And that is what the data discovery team that I propose in this blog post should work on: searching for data. In an enterprise data reality, searching for data is a bit of a hassle.

Metadata 147

Metadata Data Science Big Data Data 147

Tweag

MARCH 6, 2024

Three years ago, a blog post introduced destination-passing style (DPS) programming in Haskell, focusing on array processing, for which the API was made safe thanks to Linear Haskell. The present blog post is mostly based on my recent paper Destination-passing style programming: a Haskell implementation , published at JFLA 2024.

Programming 131

Programming Data Programming Language Coding 131

Waitingforcode

AUGUST 1, 2024

Welcome to the second blog post dedicated to the previous Data+AI Summit. This time I'm going to share with you a summary of Apache Spark talks.

Data 130

Data 130

Waitingforcode

JULY 10, 2024

Welcome to the first Data+AI Summit 2024 retrospective blog post. I'm opening the series with the topic close to my heart at the moment, stream processing!

Data 130

Data Process 130

Waitingforcode

MARCH 5, 2024

I'm writing this unexpected blog post because I got stuck with watermarks and checkpoints and felt that I was missing some basics. Even though this introduction is a bit negative, the exploration for the data reading enabled my other discoveries.

Data 130

Data 130

databricks

JUNE 6, 2024

This blog is authored by Bhaskar Palit , Senior Director, Data & Analytics, PepsiCo, and Sudipta Das , Data Architect Senior Manager, PepsiCo.

Data Architect 128

Data Architect Data Management 128

Waitingforcode

JANUARY 9, 2025

An alternative is the RESTORE command, and it'll be the topic of this blog post. Time travel is a quite popular Delta Lake feature. But do you know it's not the single one you can use to interact with the past versions?

IT 130

IT 130

Waitingforcode

MAY 9, 2024

Well, not really but I let you discover why in this blog post. While I have been exploring arbitrary stateful processing, hence the mapGroupsWithState among others, I mistakenly created a batch DataFrame and applied the mapping function on top of it. Turns out, it worked!

Process 130

Process IT 130

Waitingforcode

MAY 7, 2024

I wrote a blog post about OutputModes 6 (yes!) years ago and after reading it a few times, I realized it was not good enough to be a quick refresher. For that reason you can read about OutputModes for the second time here. Hopefully, this one will be a good try!

IT 130

IT 130

Waitingforcode

JUNE 24, 2024

I'm writing this blog post to remember them and why not, share the knowledge with you! Last May I gave a talk about stream processing fallacies at Infoshare in Gdansk. Besides this speaking experience, I was also - and maybe among others - an attendee who enjoyed several talks in software and data engineering areas.

Data Engineering 130

Data Engineering Data Engineer Engineering Process 130

Christophe Blefari

MARCH 8, 2024

I mean, there is a big difference between podcast for instance and news blogging like I'm doing. Architecture I said it, while being a new feature to the blog this is as well an educational projet I can use to showcase technologies. The main part of the blog is just a bunch of Handlebars templates connected to Ghost Content API.

Data 130

Data Algorithm Database Education 130

KDnuggets

DECEMBER 7, 2023

This blog post explores NotebookLM, its functionality, limitations, and advanced features essential for researchers and scientists.

Data Science 138

Data Science Data IT 138

databricks

JANUARY 27, 2025

This blog describes the new change feed and snapshot capabilities in Apache Spark Structured Streamings State Reader API. The State Reader API enables.

Data 108

Data 108

databricks

SEPTEMBER 1, 2024

Within the Databricks Community, there is a technical blog where community members share best practices, tutorials and insights on data analytics, data engineering.

Data Analytics 105

Data Analytics Data Data Engineering Data Engineer 105

databricks

AUGUST 16, 2024

This blog was written in collaboration with Gordon Strodel, Director, Data Strategy & Analytics Capability, in addition to Abhinav Batra, Associate Principal, Enterprise.

Building 122

Building Data Healthcare 122

KDnuggets

FEBRUARY 1, 2024

This blog covers non-technical, Python, SQL, statistics, data analysis, and machine learning questions. Learn about the most common questions asked during data science interviews.

Data Science 134

Data Science Machine Learning Data Analysis SQL 134

Rockset

JUNE 21, 2024

Read more: OpenAI’s blog post FAQs for Rockset customers Their support and belief in us have been the bedrock of our success. We look forward to continuing what we’ve started at Rockset and supporting OpenAI’s mission of building safe, beneficial AGI.

Database 145

Database Cloud Accessible Accessibility 145

databricks

AUGUST 30, 2024

Within the Databricks Community, there is a technical blog where community members share best practices, tutorials and insights on data analytics, data engineering.

Data Analytics 104

Data Analytics Data Engineering Data Engineer Engineering 104

Waitingforcode

JANUARY 15, 2025

A few months ago I wrote a blog post about event skew and how dangerous it is for a stateful streaming job. Since it was a high-level explanation, I didn't cover Apache Spark Structured Streaming deeply at that moment.

IT 130

IT 130

databricks

SEPTEMBER 30, 2024

This blog explores how new technologies such as Databricks Data Intelligence Platform can pave the way for more effective and efficient multi-omics data management.

Data Management 118

Data Management Management Data Technology 118

Data Engineering Weekly

JULY 28, 2024

The blog is an excellent summarization of the common patterns emerging in GenAI platforms. The blog Prompt Engineering for a Better SQL Code Generation With LLMs is a pretty good guide on applying prompt engineering to improve productivity. Swiggy recently wrote about its internal platform, Hermes, a text-to-SQL solution.

Data Engineering 109

Data Engineering Data Engineer Engineering Database-centric 109