Tue.Jan 28, 2025

article thumbnail

Don’t Manage Your Python Environments, Just Use Docker Containers

KDnuggets

Python environment management can sometimes give you that awful feeling in the pit of your stomach. So don't do it: just use Docker containers.

Python 137
article thumbnail

How to ensure consistent metrics in your warehouse

Start Data Engineering

1. Introduction 2. Centralize Metric Definitions in Code Option A: Semantic Layer for On-the-Fly Queries Option B: Pre-Aggregated Tables for Consumers 3. Conclusion & Recap 4. Required Reading 1. Introduction If youve worked on a data team, youve likely encountered situations where multiple teams define metrics in slightly different ways, leaving you to untangle why discrepancies exist.

Utilities 147
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

The Role of AI in Shaping the Future of Work

KDnuggets

Rather than fearing AI, we should see it as a tool that complements human skills, helping professionals focus on high-value work and enhancing job roles.

IT 127
article thumbnail

Global Fishing Watch – Illuminating Vessel Activity On the Open Ocean

ArcGIS

Having fish for dinner tonight? Ever wondered if anyone is monitoring where it's coming from?

IT 105
article thumbnail

Apache Airflow® 101 Essential Tips for Beginners

Apache Airflow® is the open-source standard to manage workflows as code. It is a versatile tool used in companies across the world from agile startups to tech giants to flagship enterprises across all industries. Due to its widespread adoption, Airflow knowledge is paramount to success in the field of data engineering.

article thumbnail

Empowering Personalized Banking Experiences

databricks

At Zafin , our mission is to help banks modernize their core infrastructure to deliver exceptional, personalized experiences to their customers. To determine.

Banking 100

More Trending

article thumbnail

Introducing Real-Time Embeddings: Any Model, Any Vector Database—No Code Needed

Confluent

Confluents Create Embeddings Action for Flink helps you generate vector embeddings from real-time data to create a live semantic layer for your AI workflows.

article thumbnail

Simplify Data Warehouse Migrations: Free SnowConvert with Redshift Support

Snowflake

Migrating from a traditional data warehouse to a cloud data platform is often complex, resource-intensive and costly. At Snowflake, we believe every organization should benefit from an easy, enterprise-grade and collaborative cloud AI and data platform and should be able to make that transition as fast and automatic as possible. Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for d

article thumbnail

Battle of the Ducks

Towards Data Science

DuckDB vs Fireducks: the ultimate throwdown Continue reading on Towards Data Science

article thumbnail

Simplify Data Warehouse Migrations: Free SnowConvert

Snowflake

Migrating from a traditional data warehouse to a cloud data platform is often complex, resource-intensive and costly. At Snowflake, we believe every organization should benefit from an easy, enterprise-grade and collaborative cloud AI and data platform and should be able to make that transition as fast and automatic as possible. Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for d

article thumbnail

Apache Airflow® Best Practices: DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Confluent Champion Maria on the Power of a Motivated Workplace

Confluent

In our latest Confluent Champion, staff solutions engineer Maria Berinde-Tampanariu shares how Confluent fosters a culture of motivation and growth.

article thumbnail

What is Artificial Intelligence (AI)?

WeCloudData

Have you noticed how Siri understands your request effortlessly and how Netflix seems to know exactly what you’ll want to watch next? These simple interactions are not magic or coincidence, but are the common application of Artificial Intelligence. AI influences every aspect of our lives. We interact with it every day, whether during exercise, work, […] The post What is Artificial Intelligence (AI)?

IT 52
article thumbnail

Battle of the Ducks

Towards Data Science

DuckDB vs Fireducks: the ultimate throwdown Continue reading on Towards Data Science