dbt Developer Hub

JANUARY 22, 2025

The main thing I knew going in was "SDF understands SQL". For the next era of Analytics Engineering to be as transformative as the last, dbt needs to move beyond being a string preprocessor and into fully comprehending SQL. Today we're going to dig into what SQL comprehension actually means, since it's so critical to what comes next.

SQL 78

SQL Database Coding Technology 78

KDnuggets

JUNE 10, 2024

Learn SQL and databases through free courses, tutorials, tools, guides, books, practice exercises, projects, awesome lists, and other resources.

SQL 144

SQL Database Project 144

KDnuggets

JUNE 12, 2024

A simple tutorial on how to connect to databases, execute SQL queries, and analyze and visualize data.

SQL 157

SQL Python Database Data 157

KDnuggets

JULY 31, 2024

If you work in data, you’ll write SQL queries all the time. So how do you write efficient SQL queries that are optimized for performance? This tutorial will help you with just that.

SQL 138

SQL Data 138

Snowflake

APRIL 11, 2024

Data is the lifeblood of modern businesses, but unlocking its true insights often requires complex SQL queries. We’re thrilled to announce the public preview of Snowflake Copilot, a new solution on the bleeding edge of text-to-SQL that simplifies data analysis while maintaining robust governance.

SQL 140

SQL AWS Data Analysis High Quality Data 140

Data Engineering Podcast

FEBRUARY 4, 2024

Summary Stream processing systems have long been built with a code-first design, adding SQL as a layer on top of the existing framework. There are numerous stream processing engines, near-real-time database engines, streaming SQL systems, etc. Can you describe what RisingWave is and the story behind it?

SQL 173

SQL Data Lake High Quality Data Machine Learning 173

KDnuggets

AUGUST 12, 2024

Today, we’re looking for five quality resources that will teach you advanced SQL and do it for free.

SQL 143

SQL IT 143

Striim

NOVEMBER 19, 2024

SQL2Fabric Mirroring is a new fully managed service offered by Striim to mirror on premise SQL Databases. It’s a collaborative service between Striim and Microsoft based on Fabric Open Mirroring that enables real-time data replication from on-premise SQL Server databases to Azure Fabric OneLake. Establish a secure connection (e.g.,

SQL 52

SQL Database Data Warehouse Data Pipeline 52

KDnuggets

JUNE 26, 2024

Learning SQL in 2024 is essential as it remains the most in-demand skill for data professionals, enabling efficient management and analysis of large datasets.

SQL 133

SQL Datasets Management IT 133

databricks

OCTOBER 14, 2024

Over the last few years, we've seen tremendous growth and adoption of Databricks SQL , our intelligent data warehouse purpose-built on the Data.

SQL 131

SQL Data Warehouse Data 131

KDnuggets

NOVEMBER 1, 2024

This is a simple guide for lazy people who want to learn SQL with minimal effort.

SQL 138

SQL 138

databricks

SEPTEMBER 10, 2024

We are excited to share the latest new features and performance improvements that make Databricks SQL simpler, faster and lower cost than ever.

SQL 128

SQL 128

KDnuggets

MARCH 5, 2024

Looking to learn SQL and databases to level up your data science skills? Learn SQL, database internals, and much more with these free university courses.

SQL 144

SQL Database Data Science Data 144

KDnuggets

OCTOBER 12, 2023

SQL is the essential data science language due to its universal database accessibility, efficient data cleaning capabilities, seamless integration with other languages, and requirement for most data science jobs.

Data Science 154

Data Science SQL Database Data 154

KDnuggets

NOVEMBER 12, 2024

In this tutorial, we’ll explore when and how SQL functionality can be integrated within the Pandas framework, as well as its limitations.

SQL 140

SQL Data Analysis Data IT 140

databricks

JANUARY 31, 2024

Welcome to the blog series covering product advancements in 2023 for Databricks SQL, the serverless data warehouse from Databricks. This is part 2.

SQL 130

SQL Programming Data Warehouse Data 130

Sync Computing

FEBRUARY 4, 2025

Thats why weve created a Databricks Health SQL Toolkit a free set of queries you can copy, paste, and run to get instant insights into your environment. Wow the team with insights in your Jobs, SQL warehouses, APC clusters, and DLT usage. Go here for the query What are the most expensive SQL warehouses for the last 30 days?

SQL 52

SQL Datasets Utilities Accessible 52

KDnuggets

MARCH 13, 2024

If you are a data scientist who works with large amounts of data and hasn’t learned SQL yet - now might be the time.

SQL 150

SQL Data Science Certification Data 150

Waitingforcode

JANUARY 23, 2025

Even though Apache Spark SQL provides an API for structured data, the framework sometimes behaves unexpectedly. It's the case of an insertInto operation that can even lead to some data quality issues. Let's try to understand in this short article.

SQL 130

SQL Structured Data IT Data 130

Start Data Engineering

MAY 21, 2024

Introduction 2. Enabling Stakeholder data access with RAGs 3.1. Set up 3.1.1. Pre-requisite 3.1.2. Demo 3.1.3. Key terminology 3.2. Loading: Read raw data and convert them into LlamaIndex data structures 3.2.1. Read data from structured and unstructured sources 3.2.2. Transform data into LlamaIndex data structures 3.3.

Accessibility 213

Accessibility Accessible SQL Raw Data 213

databricks

AUGUST 13, 2024

Databricks SQL Serverless is now Generally Available on Google Cloud Platform (GCP)! SQL Serverless is available in 7 GCP regions and 40+ regions across AWS, Azure and GCP.

Google Cloud 131

Google Cloud SQL Cloud AWS 131

KDnuggets

SEPTEMBER 25, 2024

This tutorial introduces the basics of SQL querying with Google BigQuery. While very similar, BigQuery SQL has some syntax differences with standard SQL, some of which will be highlighted along the post. For those familiar with SQL, adapting to BigQuery should be pretty straightforward.

SQL 118

SQL 118

KDnuggets

JANUARY 14, 2025

What are essential commands for data analysis in SQL? This article will answer this question by mentioning 10 SQL commands. As a bonus, well add some other SQL commands that are not that common but will certainly add flexibility to your analyses.

Data Analysis 115

Data Analysis SQL Data 115

Start Data Engineering

FEBRUARY 3, 2025

Split your SQL into smaller parts 2.1. Introduction If you’ve been in the data space long enough, you would have come across really long SQL scripts that someone had written years ago. Introduction 2. Start with a baseline validation to ensure that your changes do not change the output too much 2.2. Conclusion 4.

SQL 147

SQL Data Pipeline Data 147

Waitingforcode

FEBRUARY 26, 2025

Is there an easier way to address the insertInto position-based data writing in Apache Spark SQL? Totally, if you use a column-based method such as saveAsTable with append mode.

SQL 130

SQL Data 130

databricks

JULY 31, 2024

We’re excited to announce the Public Preview of LakeFlow Connect for SQL Server, Salesforce, and Workday. These ingestion connectors enable simple and efficient.

SQL 135

SQL Data Data Engineer Data Engineering 135

KDnuggets

FEBRUARY 6, 2024

This article introduced you to the world of ranking functions in SQL. We will cover the basics of how they work, how they're used, and how to avoid common pitfalls.

SQL 138

SQL 138

databricks

DECEMBER 4, 2024

Databricks launches two new self-paced trainings to enhance SQL and AI-powered analytics skills The "Get Started with SQL analytics and BI" course covers how to use Databricks SQL for data analysis and Databricks AI/BI Dashboards and Genie spaces Additional courses being developed include "Databricks AI/BI for self-service analytics" and a deep dive (..)

BI 59

BI SQL Data Analysis Building 59

Start Data Engineering

OCTOBER 17, 2024

Introduction Setup SQL tips 1. Handy functions for common data processing scenarios 1.1. Need to filter on WINDOW function without CTE/Subquery use QUALIFY 1.2. Need the first/last row in a partition, use DISTINCT ON 1.3. STRUCT data types are sorted based on their keys from left to right 1.4.

SQL 130

SQL Data Engineering Data Engineer Engineering 130

DataKitchen

FEBRUARY 17, 2025

No Python, No SQL Templates, No YAML: Why Your Open Source Data Quality Tool Should Generate 80% Of Your Data Quality Tests Automatically As a data engineer, ensuring data quality is both essential and overwhelming. Writing SQL, Python, or YAML-based rules should not be a prerequisite for their involvement.

SQL 73

SQL Python Government Data Engineering 73

KDnuggets

NOVEMBER 20, 2024

Can SQL be used for advanced data manipulation in data science? It sure can with these seven techniques.

Data Science 126

Data Science SQL Data IT 126

databricks

NOVEMBER 5, 2024

We’re excited to announce that materialized views (MVs) and streaming tables (STs) are now Generally Available in Databricks SQL on AWS and Azure.

SQL 132

SQL AWS Engineering 132

KDnuggets

JANUARY 15, 2024

Learn the generic scenarios and techniques of grouping and aggregating data, partitioning and ranking data in SQL, which will be very helpful in reporting requirements.

SQL 141

SQL Aggregated Data Data Science Data 141

Data Engineering Podcast

JUNE 25, 2023

Summary Data transformation is a key activity for all of the organizational roles that interact with data. Because of its importance and outsized impact on what is possible for downstream data consumers it is critical that everyone is able to collaborate seamlessly.

Data Engineering 225

Data Engineering Data Engineer Python Engineering 225

databricks

JANUARY 18, 2024

This is part 1 of a blog series where we look back at the major areas of progress for Databricks SQL in 2023.

SQL 138

SQL 138

Seattle Data Guy

FEBRUARY 26, 2024

SQL Server Integration Services (SSIS) comes with a lot of functionality useful for extracting, transforming, and loading data. It can also play important roles in application development and other projects. But SSIS is far from the only platform that can provide these services.

SQL 130

SQL Project Data Consulting 130

dbt Developer Hub

APRIL 20, 2025

This contextual understanding is essential for generating accurate SQL, answering business questions, and providing trustworthy data insights. Users can ask for "monthly revenue by region" and get accurate results that match your organization's standard metric definitions, with a higher baseline of accuracy than LLM generated SQL queries.

Structured Data 98

Structured Data SQL BI Project 98