KDnuggets

JANUARY 23, 2025

Lets learn how to move your model from development into production.

Machine Learning 133

Machine Learning 133

Waitingforcode

JANUARY 23, 2025

Even though Apache Spark SQL provides an API for structured data, the framework sometimes behaves unexpectedly. It's the case of an insertInto operation that can even lead to some data quality issues. Why? Let's try to understand in this short article.

SQL 130

SQL Structured Data IT Data 130

KDnuggets

JANUARY 23, 2025

Learn these 3 simple (but lengthy) steps that you need to take before applying for jobs.

89

89

Ascend.io

JANUARY 23, 2025

Data teams are under more pressure than ever before, with demands skyrocketing and technology outpacing teams ability to adapt. Understanding how your team stacks up against these challenges is crucialit could mean the difference between leading the charge and falling behind. Over the past five years, Ascend.io has conducted the industry-wide Pulse Survey to capture the current state of data teams.

Data Engineer 52

Data Engineer Data Engineering Engineering Data 52

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

Snowflake

JANUARY 23, 2025

AI is proving that its here to stay. While 2023 brought wonder and 2024 saw widespread experimentation, 2025 will be the year that the public sector gets serious about AI's applications. But its complicated: AI proofs of concept are graduating from the sandbox to production, just as some of AIs biggest cheerleaders are turning a bit dour. How to navigate such a landscape is top of mind for me and top executives such as Snowflakes CEO, Sridhar Ramaswamy; Snowflakes Distinguished AI Engineer, Yuxi

Education 97

Education Data Science Government Data Analysis 97

Precisely

JANUARY 23, 2025

The 2025 Outlook: Data Integrity Trends and Insights report is here! What are the latest data integrity trends you need to know about? How does your data program compare to your peers? Find out in the report, published in partnership between Precisely and Drexel Universitys LeBow College of Business. This years report is filled with actionable strategic insights from over 550 leading data and analytics professionals worldwide and its going to be an essential resource as you plan your 2025 data

Data Programming 64

Data Programming Programming Data Integration Data 64

dbt Developer Hub

JANUARY 23, 2025

You ever wonder whats really going on in your database when you fire off a (perfect, efficient, full-of-insight) SQL query to your database? OK, probably not . Your personal tastes aside, weve been talking a lot about SQL Comprehension tools at dbt Labs in the wake of our acquisition of SDF Labs, and think that the community would benefit if we included them in the conversation too!

SQL 52

SQL Technology Metadata Datasets 52

Monte Carlo

JANUARY 23, 2025

Here’s a thing people say all the time: Bad data costs businesses millions of dollars. This is usually followed by an earnest pitch for data quality governance – you know, the whole apparatus of rules and systems meant to keep your data clean and trustworthy. The logic goes something like: messy data lost money need governance problem solved.

Government 52

Government Data Governance Data Datasets 52