KDnuggets

APRIL 2, 2025

Go beyond the basics by adding these cool and useful Python functions to your programming toolbox.

Python 127

Python Programming 127

Snowflake

APRIL 2, 2025

Data storage has been evolving, from databases to data warehouses and expansive data lakes, with each architecture responding to different business and data needs. Traditional databases excelled at structured data and transactional workloads but struggled with performance at scale as data volumes grew. The data warehouse solved for performance and scale but, much like the databases that preceded it, relied on proprietary formats to build vertically integrated systems.

Data Lake 91

Data Lake Metadata Cloud Storage Data Warehouse 91

Engineering at Meta

APRIL 2, 2025

Open source has played an essential role in the tech industry and beyond. Whether in the AI/ML, web, or mobile space, our open source community grew and evolved while connecting people worldwide. At Meta Open Source , 2024 was a year of growth and transformation. Our open source initiatives addressed the evolving needs and challenges of developerspowering breakthroughs in AI and enabling the creation of innovative, user-focused applications and experiences.

Portfolio 75

Portfolio Media Project Building 75

Precisely

APRIL 2, 2025

While the technology continues to be a male-dominated industry, more women are pursuing careers in the space, driving meaningful change and innovation. At Precisely, recognizing the impact that women have in tech and championing their contributions is a top priority. To support this, the Precisely Women in Technology (PWIT) network, was created as a dedicated place for women to connect, share experiences, and learn from one another.

Technology 59

Technology Project Engineering Programming 59

Advertisement

With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you

Data Engineering

Cloudyard

APRIL 2, 2025

Read Time: 3 Minute, 9 Second Snowpark Magic: Auto-Create Tables from S3 Folders In modern data lakes, its common for departments like Finance, Marketing, Sales, etc., to continuously drop data files into their respective folders within an S3 bucket. These files often arrive in CSV format, and over time, teams request new folders or refresh their data.

Finance 52

Finance Data Lake Python Coding 52

KDnuggets

APRIL 2, 2025

Learn cloud computing concepts, tools, and best practices through free, community-driven content on GitHub.

Cloud Computing 103

Cloud Computing Cloud 103

KDnuggets

APRIL 2, 2025

Let's discover what small language models (SLMs) are, how they can be used in RAG systems and applications, and when to use them over their large language counterparts.

Systems 98

Systems 98

databricks

APRIL 2, 2025

Were excited to announce the General Availability of Lakeflow Connect for Salesforce and Workday.

Database 82

Database Coding 82

ArcGIS

APRIL 2, 2025

Create custom projections with only two coordinates and then turn them into icons for endless possibilities.

Project 69

Project 69

databricks

APRIL 2, 2025

Are you a startup building core, customer-facing B2B products on Databricks? Then we have a Challenge for you! On the heels of our Generative AI.

Building 64

Building 64

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

Software Engineer

Confluent

APRIL 2, 2025

Application engineers situated at the beginning of a data pipeline ("left side") should apply data contracts and products as rigorously as the data engineers further down the line.

Technology 51

Technology Process Data Pipeline Data Engineering 51

databricks

APRIL 2, 2025

Since our launch on Google Cloud Platform (GCP) in 2021, Databricks on Google Cloud has provided more than 1,500 joint customers with a tightly integrated.

Google Cloud 64

Google Cloud Cloud Data 64

Snowflake

APRIL 2, 2025

For many organizations across industries, the era of experimental AI has given way to the era of practical implementation. Even those companies still testing and evaluating AI solutions are shifting away from the art of the possible to focus more closely on what will soon produce measurable ROI. It will no longer be enough for your organization to merely use AI to win the approval of company leadership, says Samuel Lee, Product Marketing Director for Financial Services at Snowflake.

Manufacturing 54

Manufacturing Amazon Web Services AWS Government 54

Edureka

APRIL 2, 2025

Spear phishing represents one of the most sophisticated forms of cyberattacks today. Unlike mass phishing campaigns, these attacks target specific individuals or organizations by leveraging tailored research, psychological manipulation, and sometimes even artificial intelligence. In this blog, we’ll provide an in-depth look at spear phishing from its definition and techniques to prevention strategies and emerging trends.

Finance 40

Finance Media Accessible Accessibility 40

Advertisement

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

Datasets