How to Write SQL in Native Python
KDnuggets
FEBRUARY 1, 2022
If the idea of being able to link with SQL databases and define, manipulate, and query using Python sounds appealing, check out the SQLModel library.
Join 37,000+
Insiders
Sign Up for our Newsletter
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Trending Sources
Seamless SQL And Python Transformations For Data Engineers And Analysts With SQLMesh
Data Engineering Podcast
JUNE 25, 2023
__init__ covers the Python language, its community, and the innovative ways it is being used. __init__ covers the Python language, its community, and the innovative ways it is being used. Closing Announcements Thank you for listening! Don't forget to check out our other shows. Closing Announcements Thank you for listening!
Data Engineer 
225
225 
Polars – Laziness and SQL Context.
Confessions of a Data Guy
MAY 7, 2023
I mean you have a problem if you could use Polars Python, and you find yourself using […] The post Polars – Laziness and SQL Context. It’s gotten so bad, I’ve started to use it in my Rust code on the side, Polars that is. appeared first on Confessions of a Data Guy.
SQL 182
182 
No Python, No SQL Templates, No YAML: Why Your Open Source Data Quality Tool Should Generate 80% Of Your Data Quality Tests Automatically
DataKitchen
FEBRUARY 17, 2025
No Python, No SQL Templates, No YAML: Why Your Open Source Data Quality Tool Should Generate 80% Of Your Data Quality Tests Automatically As a data engineer, ensuring data quality is both essential and overwhelming. Writing SQL, Python, or YAML-based rules should not be a prerequisite for their involvement.
SQL 74
74 
SQL Injection: The Cyber Attack Hiding in Your Database
Analytics Vidhya
FEBRUARY 2, 2023
Introduction SQL injection is an attack in which a malicious user can insert arbitrary SQL code into a web application’s query, allowing them to gain unauthorized access to a database. It occurs when user input is […] The post SQL Injection: The Cyber Attack Hiding in Your Database appeared first on Analytics Vidhya.
Database 209
209 
Top SQL Queries for Data Scientists
KDnuggets
MAY 31, 2024
SQL seems like a data science underdog compared to Python and R. However, it’s far from it. I’ll show you here how you can use it as a data scientist.
SQL 142
142 
5 Simple Steps Series: Master Python, SQL, Scikit-learn, PyTorch & Google Cloud
KDnuggets
NOVEMBER 2, 2023
Dive into KDnuggets Back to Basics: Getting Started in 5 Steps series to help you master Python, SQL, Scikit-learn, PyTorch, and Google Cloud Platform.
Google Cloud 130
130 
SQL in Pandas with Pandasql
KDnuggets
OCTOBER 4, 2023
Want to query your pandas dataframes using SQL? Learn how to do so using the Python library Pandasql.
SQL 135
135 
Tackling Real Time Streaming Data With SQL Using RisingWave
Data Engineering Podcast
FEBRUARY 4, 2024
Summary Stream processing systems have long been built with a code-first design, adding SQL as a layer on top of the existing framework. There are numerous stream processing engines, near-real-time database engines, streaming SQL systems, etc. __init__ covers the Python language, its community, and the innovative ways it is being used.
SQL 173
173 
KDnuggets Top Posts for January 2023: SQL and Python Interview Questions for Data Analysts
KDnuggets
MARCH 22, 2023
SQL and Python Interview Questions for Data Analysts • 5 SQL Visualization Tools for Data Engineers • 5 Free Tools For Detecting ChatGPT, GPT3, and GPT2 • Top Free Resources To Learn ChatGPT • Free TensorFlow 2.0
SQL 121
121 
KDnuggets News, November 8: 5 Simple Steps to Master Python, SQL, Scikit-learn, PyTorch & Google Cloud • SQL for Data Visualization
KDnuggets
NOVEMBER 8, 2023
This week on KDnuggets: Dive into KDnuggets Back to Basics: Getting Started in 5 Steps series to help you master Python, SQL, Scikit-learn, PyTorch, and Google Cloud Platform. Unlock the Power of SQL in Data Visualization: Master the Art of Preparing Data for Impactful Charts and Graphs. • And much, much more!
Google Cloud 115
115 
SQL or Python for Data Transformations?
Start Data Engineering
JULY 1, 2024
Introduction 2. Code is an interface to the execution engine 3. How to choose the execution engine and the coding interface 3.1. Chose execution engine based on your workload 3.1.1. Types of execution engine 3.1.2. Criteria to chose your execution engine 3.2. Chose coding interface for people who will maintain the pipeline 3.2.1.
SQL 130
130 
Interesting startup idea: benchmarking cloud platform pricing
The Pragmatic Engineer
OCTOBER 17, 2024
Python, Angular, SSR, SQLite, DuckDB, Cockroach DB, and many others. Interested in how the site works, and what the business model is for a service like this, I reached out to Spare Cores founder Gergely Daróczi, who shared in-depth details about the company, including lots of specifics about the tech stack. Tech stack.
Cloud 326
326 
Accelerate AI Development with Snowflake
Snowflake
NOVEMBER 11, 2024
GPU-based model development and deployment: Build powerful, advanced ML models with your preferred Python packages on GPUs or CPUs serving them for inference in containers — all within the same platform as your governed data. Traditionally, SQL has been limited to structured data neatly organized in tables.
Snowflake’s New Python API Empowers Data Engineers to Build Modern Data Pipelines with Ease
Snowflake
APRIL 17, 2024
Yet while SQL applications have long served as the gateway to access and manage data, Python has become the language of choice for most data teams, creating a disconnect. Recognizing this shift, Snowflake is taking a Python-first approach to bridge the gap and help users leverage the power of both worlds.
Data Pipeline 123
123 
Snowflake To Acquire Ponder, Boosting Python Capabilities In the Data Cloud
Snowflake
OCTOBER 23, 2023
One of our goals at Snowflake is to ensure we continue to deliver a best-in-class platform for Python developers. Snowflake customers are already harnessing the power of Python through Snowpark , a set of runtimes and libraries that securely deploy and process non-SQL code directly in Snowflake.
Python 141
141 
How Meta discovers data flows via lineage at scale
Engineering at Meta
JANUARY 22, 2025
Hack, C++, Python, etc.) such as web systems and backend services, and batch-processing systems that process data rows in batch (mainly via SQL) such as data warehouse and AI systems. The involved SQL queries are logged for data processing activities by the Presto and Spark compute engines (among others).
Data Warehouse 118
118 
Announcing DeepSeek-R1 in private preview on Snowflake Cortex AI
Snowflake
JANUARY 29, 2025
The model is available in private preview for serverless inference for both batch (SQL function) and interactive (Python and REST API). SQL and Python The model can be integrated into a data pipeline or a Streamlit in Snowflake app to process multiple rows in a table. The model is hosted in the U.S.
Data News — Week 25.02
Christophe Blefari
JANUARY 11, 2025
Agents write python code to call tools and orchestrate other agents. Python and Java still leads the programming language interest, but with a decrease in interest (-5% and -13%) while Rust gaining traction (+13%), not sure it's related, tho. smolagents — HuggingFace released a barebones library for agents.
Data 130
130 
How to get started with dbt
Christophe Blefari
MARCH 1, 2023
dbt Core is an open-source framework that helps you organise data warehouse SQL transformation. In a simple words dbt sits on top of your raw data to organise all your SQL queries that are defining your data assets. Jinja templating — Jinja is a templating engine that seems to exist forever in Python.
Data Warehouse 278
278 
Stop Overcomplicating Data Quality
Towards Data Science
DECEMBER 10, 2024
Ultimately, all you need for dynamic data lineage is a machine that scans your SQL files, and something to output a user-friendly lineage map. Thanks to Python, this can be achieved using a script with as few as 100 lines ofcode. If you know a bit of Python and LLM prompting you should be able to hack the code in an hour.
PostgreSQL 75
75 
Troubleshooting Kafka In Production
Data Engineering Podcast
DECEMBER 24, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
Kafka 245
245 
Automating Customer Data Load with DBT & Snowflake
Cloudyard
MAY 4, 2025
All of this, defined inside DBT using just SQL and macros , without any Airflow, Python scripts, or manual schema management. Yes DBT is primarily known as a transformation tool , where you take raw data already inside your warehouse and clean, enrich, or model it using SQL. Macro DBT Model: Ingest & Load the Data.
ETL Tools 59
59 
Building Linked Data Products With JSON-LD
Data Engineering Podcast
SEPTEMBER 17, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
Building 189
189 
25 Free Books to Master SQL, Python, Data Science, Machine Learning, and Natural Language Processing
KDnuggets
DECEMBER 28, 2023
Discover a collection of best books to start your data career or master a new skill, all for free!
Machine Learning 147
147 
Using Trino And Iceberg As The Foundation Of Your Data Lakehouse
Data Engineering Podcast
FEBRUARY 18, 2024
Summary A data lakehouse is intended to combine the benefits of data lakes (cost effective, scalable storage and compute) and data warehouses (user friendly SQL interface). __init__ covers the Python language, its community, and the innovative ways it is being used. Your first 30 days are free! Data lakes are notoriously complex.
Data Lake 262
262 
Collection of Guides on Mastering SQL, Python, Data Cleaning, Data Wrangling, and Exploratory Data Analysis
KDnuggets
MARCH 20, 2024
Are you curious about what it takes to become a professional data scientist? Look no further! By following these guides, you can transform yourself into a skilled data scientist and unlock endless career opportunities.
Data Analysis 136
136 
Data News — Week 24.11
Christophe Blefari
MARCH 15, 2024
yato, is a small Python library that I've developed, yato stands for yet another transformation orchestrator. With yato you give a folder with SQL queries and it guesses the DAG and runs the queries in the right order. BigQuery supports DELETE to delete partitions in a SQL query. Give a lot of insights on the market.
Metadata 272
272 
An Overview Of The Sate Of Data Orchestration In An Increasingly Complex Data Ecosystem
Data Engineering Podcast
SEPTEMBER 10, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
BI 208
208 
Reducing The Barrier To Entry For Building Stream Processing Applications With Decodable
Data Engineering Podcast
OCTOBER 15, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
Process 182
182 
Snowflake PARSE_DOC Meets Snowpark Power
Cloudyard
JANUARY 15, 2025
Traditionally, this function is used within SQL to extract structured content from documents. Its SQL usage is straightforward, making it easy to integrate into existing pipelines. This is where Snowpark shines, offering Pythons versatility while operating seamlessly within Snowflake.
Data Cleanse 52
52 
Eliminate The Overhead In Your Data Integration With The Open Source dlt Library
Data Engineering Podcast
SEPTEMBER 3, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
Data Integration 162
162 
Tools Every Data Scientist Should Know: A Practical Guide
KDnuggets
JULY 12, 2024
Discover the essential tools every data scientist should know to elevate their data science game, from Python and R to SQL and advanced visualization tools.
Data Science 147
147 
Calling All Builders: Get Hands-On With AI and Apps
Snowflake
NOVEMBER 4, 2024
And for all you Python builders out there, don’t miss the instructor-led lab, where you will learn how to create an end-to-end data pipeline seamlessly in Python using Snowflake Notebooks with the Snowflake pandas API. On Day 2, you’ll learn to build sophisticated AI apps using RAG with Snowflake Cortex Search.
Introducing Snowpark pandas API: Run Distributed pandas at Scale in Snowflake
Snowflake
JUNE 5, 2024
At Snowflake we are deeply committed to delivering a best-in-class platform for Python developers. Snowflake customers are already harnessing the power of Python through Snowpark , a set of libraries and code execution environments that run Python and other programming languages next to your data in Snowflake.
Python 126
126 
Surveying The Market Of Database Products
Data Engineering Podcast
OCTOBER 29, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
Database 189
189 
Powering Vector Search With Real Time And Incremental Vector Indexes
Data Engineering Podcast
SEPTEMBER 24, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can!
SQL 147
147 
Addressing The Challenges Of Component Integration In Data Platform Architectures
Data Engineering Podcast
NOVEMBER 26, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can! Rudderstack : 
Simplifying Data Architecture and Security to Accelerate Value
Snowflake
NOVEMBER 11, 2024
In addition to free assessments and free table conversions, SnowConvert now supports accurate conversion of database views from Teradata, Oracle or SQL Server for free. While Snowpark Python has supported reading from and writing to Iceberg tables, you can also now create Iceberg tables with Snowpark Python (generally available).
Data Engineering Weekly #198
Data Engineering Weekly
NOVEMBER 24, 2024
[link] JBarti: Write Manageable Queries With The BigQuery Pipe Syntax Our quest to simplify SQL is always an adventure. The blog narrates a few examples of Pipe Syntax in comparison with the SQL queries. BigQuery's pipe syntax seems exciting to watch, and it is an interesting approach to how it gets adopted.
Snowflake Startup Challenge 2025: Meet the Top 10
Snowflake
APRIL 9, 2025
It connects structured and unstructured databases across sources and uses a no-code UI or Python for advanced and predictive analytics. With a collaborative SQL repository, it creates one place for all queries, integrating into existing workflows so users can automatically save, manage and document ad hoc SQL work on top of Snowflake.
Defining A Strategy For Your Data Products
Data Engineering Podcast
OCTOBER 22, 2023
RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. It’s the only true SQL streaming database built from the ground up to meet the needs of modern data products. With Materialize, you can! Rudderstack : 
Let's personalize your content