KDnuggets

MAY 27, 2025

You dont need to be a Python pro to write fast, clean code. Just a few smart coding habits can go a long way.

Coding 89

Coding Python 89

ArcGIS

MAY 27, 2025

In ArcGIS Pro 3.5, you can choose between three options to overwrite existing tool data, including appending and replacing data.

Data 97

Data 97

databricks

MAY 27, 2025

Until now, sharing data between enterprise systems often meant complex pipelines, duplication, and lock-in. With Oracles support for Delta Sharing, thats no longer the case.

BI 69

BI Database Systems Data 69

Data Engineering Weekly

MAY 25, 2025

Dagster Components is now here Components provides a modular architecture that enables data practitioners to self-serve while maintaining engineering quality. Built for the AI era, Components offers compartmentalized code units with proper guardrails that prevent "AI slop" while supporting code generation. See how it works in 4 easy steps Onehouse: ClickHouse vs StarRocks vs Presto vs Trino vs Apache Spark™ — Comparing Analytics Engines As we adopt the Lakehouse architecture more and

Data Engineering 62

Data Engineering Data Engineer Engineering PostgreSQL 62

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

Precisely

MAY 27, 2025

In a rapidly evolving financial landscape, one thing is clear: banks that prioritize agility and data-driven customer-centricity are not just staying afloattheyre thriving. During the recent American Banker webinar, Smart Banking in 2025: Intelligent Technologies Defining CX and Operations, I had the pleasure of speaking alongside Sarah Howell about the big shifts seen in bankingparticularly around digital transformation, compliance, and customer experience (CX).

Banking 58

Banking Technology Finance Accessibility 58

KDnuggets

MAY 27, 2025

Develop a data system that every business user wants to use.

Data 92

Data Systems 92

databricks

MAY 27, 2025

In a sign of how quickly enterprises are moving to embrace AI, 70% have moved past the pilot stage and are preparing to release new

Data 66

Data 66

Edureka

MAY 27, 2025

Microsoft Fabric is a next-generation data platform that combines business intelligence, data warehousing, real-time analytics, and data engineering into a single integrated SaaS framework. Microsoft Fabric, which is based on the principles of governance, scalability, and simplicity, enables companies to handle their whole analytics lifecycle in one location.

Architecture 52

Architecture BI Business Intelligence Raw Data 52

ArcGIS

MAY 27, 2025

Learn how to analyze the relationships between your network features and structures using ArcGIS Utility Network.

Utilities 62

Utilities Data Management Management Data 62

KDnuggets

MAY 27, 2025

These ten compact and pythonic shortcuts will boost your time data analysis and processing workflows. See how and why.

Python 75

Python Data Analysis Process Data 75

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Pipeline-centric

Snowflake

MAY 23, 2025

Consider the numbers: 23, 9.63, 368. On the surface, they are but simple data points the most Olympic gold medals won by a single individual (Hint: Hes a Team USA athlete!); the winning time, in seconds, of the mens 100-meter dash in London; the world record, in pounds, a female Paralympic powerlifter has ever benchpressed. But behind every number there is a story of hardship, perseverance and achievement.

Data 105

Data Data Security Architecture Technology 105

databricks

MAY 23, 2025

Complexities of Extracting SQL Server Data While digital native companies recognize AI's critical role in driving innovation, many still face challenges in making their data

Data Ingestion 69

Data Ingestion SQL Data 69

Edureka

MAY 27, 2025

Imagine entering a control room with complete control over your data ecosystem. You won’t have to deal with siloed systems, jump between tools, or write endless lines of code to make data useful. That’s how Microsoft Fabric works. With its ability to seamlessly integrate data engineering, analytics, and business intelligence, Microsoft Fabric stands out as the all-in-one superhero in a world where data is abundant but insights are scarce.

BI 52

BI Data Pipeline Business Intelligence Data Engineering 52

Confluent

MAY 27, 2025

Discover how Account Executive Jason helps customers turn roadblocks into winspowered by Confluents collaborative, one-team culture.

45

45

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

ArcGIS

MAY 27, 2025

Discusses the enhancements introduced in ArcGIS Pro 3.5 to assist system administrators in optimizing performance settings.

Systems 65

Systems 65

Snowflake

MAY 27, 2025

Enterprises are navigating a complex landscape marked by evolving challenges in privacy, economics and the rapid advancement of AI. Consumer data privacy is no longer just an expectation its a nonnegotiable, the foundation of consumer trust. Economic volatility has pushed companies to do more with less, demanding greater efficiency amid ever-changing regulations.

Unstructured Data 81

Unstructured Data SQL Government Programming Language 81

databricks

MAY 27, 2025

Dimensional modeling is a time-tested approach to building analytics-ready data warehouses.

Data Warehouse 59

Data Warehouse SQL Data Building 59

Edureka

MAY 27, 2025

Docker completely changed the development, packaging, and deployment of applications. Docker provides consistent environments from development to production by isolating applications in containers. The Dockerfile is the foundation of this ecosystem since it serves as a guide for creating Docker images. This blog covers everything from the fundamentals to more complex subjects like comparisons, troubleshooting, and best practices.

Cloud 40

Cloud Building Certification Coding 40

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing

dbt Developer Hub

MAY 27, 2025

Today, we announced the dbt Fusion engine. Fusion isn't just one thing it's a set of interconnected components working together to power the next generation of analytics engineering. This post maps out each piece of the Fusion architecture, explains how they fit together, and clarifies what's available to you whether you're compiling from source, using our pre-built binaries, or developing within a dbt Fusion powered product experience.

Engineering 59

Engineering SQL Coding Python 59

Tweag

MAY 28, 2025

As software engineers at Modus Create, we are always on the lookout for tools that can enhance our productivity and code quality. The advent of AI-powered coding assistants such as GitHub Copilot has sparked excitement in the development community. Copilot code completions propose snippets at the current cursor that the user can quickly insert, while Copilot Chat allows users to discuss their code with an AI.

52

52

Snowflake

MAY 27, 2025

It sounds like a cliche to say it's a transformative time in telecommunications. But thats never been more accurate. Companies across the entire ecosystem are undergoing unprecedented change and incredible innovation across every aspect of the business. Fueled by efficiency, cost and customer experience pressures, telecoms must ensure that networks are not only highly reliable but easily adaptable to the rapidly changing needs of modern businesses and customers.

Telecommunication 53

Telecommunication Utilities Government Technology 53

Scott Logic

MAY 28, 2025

As ever, the public sector faces many challenges: tightening budgets, rapidly changing technologies, growing public expectations, and the urgent need to deliver services faster and more efficiently. Balancing these demands often leads to projects being blocked either by decision paralysis, often due to insufficient information or, conversely, failing miserably due to rushed, uninformed decisions.

52

52

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Edureka

MAY 27, 2025

In the world of data analytics, Microsoft Fabric and Tableau stand out as powerful tools, but they have very different strengths. While Microsoft Fabric offers an all-in-one data platform for enterprises deeply integrated with Azure, Tableau focuses on intuitive, high-quality data visualization for users at all levels. This guide compares their features, architecture, pricing, and use cases to help you decide which is the best fit for your data strategy.

BI 40

BI Data Lake Business Intelligence Raw Data 40

Precisely

MAY 27, 2025

In a rapidly evolving financial landscape, one thing is clear: banks that prioritize agility and data-driven customer-centricity are not just staying afloattheyre thriving. During the recent American Banker webinar, Smart Banking in 2025: Intelligent Technologies Defining CX and Operations, I had the pleasure of speaking alongside Sarah Howell about the big shifts seen in bankingparticularly around digital transformation, compliance, and customer experience (CX).

Banking 52

Banking Technology Finance Accessibility 52

dbt Developer Hub

MAY 27, 2025

Today, we announced that the dbt Fusion engine is available in beta. If Fusion works with your project today, great! You're in for a treat If it's your first day using dbt, welcome! You should start on Fusion you're in for a treat too. Today is Launch Day the first day of a new era: the Age of Fusion. We expect many teams with existing projects will encounter at least one issue that will prevent them from adopting the dbt Fusion engine in production environments.

Engineering 52

Engineering Python SQL Project 52

Snowflake

MAY 27, 2025

At Snowflake, our mission is to empower every enterprise to achieve its full potential through data and AI. We actively support innovative companies within our ecosystem that demonstrate clear value for our customers, which is why we're excited to invest in Honeydew , a former Snowflake Startup Challenge finalist. Honeydews Semantic Layer revolutionizes the way data teams collaborate on business intelligence and deliver impactful data-driven insights.

Business Intelligence 52

Business Intelligence BI Government Metadata 52

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineering

Scott Logic

MAY 22, 2025

I recently attended the thought provoking AI Ethics, Risks and Safety Conference 2025. It featured presentations from the UK governments Department for Science, Innovation and Technology (DSIT), the Alan Turing Institute, Mind Foundry and Google. The talks focused on trying to stimulate economic growth by building competence and confidence for UK businesses looking to adopt AI, the balance of human-AI collaboration and the wider societal and environmental impacts.

Government 52

Government Food Technology Systems 52

Edureka

MAY 27, 2025

In today’s data-driven world, the role of an AWS Data Engineer is more important than ever! Organizations are on the lookout for talented professionals who can design, build, and maintain strong data pipelines and infrastructure on the Amazon Web Services (AWS) platform. If you’re eager to kickstart your career in AWS data engineering or ready to take it to the next level, mastering the interview process is essential.

AWS 40

AWS Data Engineering Data Engineer Engineering 40

KDnuggets

MAY 23, 2025

Design, test, and deploy multi-agent systems in hours using the powerful agentic frameworks.

Python 131

Python Designing Systems 131

Confessions of a Data Guy

MAY 23, 2025

Lets be honest: working with Apache Iceberg stops being fun the moment you step off your local laptop and into anything that resembles production. The catalog systemmandatory and rigidhas long been the Achilles’ heel of an otherwise promising open data format. For a long time, you had two options: over-engineered corporate-grade solutions that require infrastructure […] The post Finally, a Simple, Cloud-Friendly Apache Iceberg Catalog That Just Works appeared first on Confessions of

Cloud 130

Cloud Engineering Data 130

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data