Tue.Jan 28, 2025

article thumbnail

How to ensure consistent metrics in your warehouse

Start Data Engineering

1. Introduction 2. Centralize Metric Definitions in Code Option A: Semantic Layer for On-the-Fly Queries Option B: Pre-Aggregated Tables for Consumers 3. Conclusion & Recap 4. Required Reading 1. Introduction If youve worked on a data team, youve likely encountered situations where multiple teams define metrics in slightly different ways, leaving you to untangle why discrepancies exist.

Utilities 147
article thumbnail

Simplify Data Warehouse Migrations: Free SnowConvert with Redshift Support

Snowflake

Migrating from a traditional data warehouse to a cloud data platform is often complex, resource-intensive and costly. At Snowflake, we believe every organization should benefit from an easy, enterprise-grade and collaborative cloud AI and data platform and should be able to make that transition as fast and automatic as possible. Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for d

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Don’t Manage Your Python Environments, Just Use Docker Containers

KDnuggets

Python environment management can sometimes give you that awful feeling in the pit of your stomach. So don't do it: just use Docker containers.

Python 138
article thumbnail

Simplify Data Warehouse Migrations: Free SnowConvert

Snowflake

Migrating from a traditional data warehouse to a cloud data platform is often complex, resource-intensive and costly. At Snowflake, we believe every organization should benefit from an easy, enterprise-grade and collaborative cloud AI and data platform and should be able to make that transition as fast and automatic as possible. Thats why we are announcing that SnowConvert , Snowflakes high-fidelity code conversion solution to accelerate data warehouse migration projects, is now available for d

article thumbnail

Mastering Apache Airflow® 3.0: What’s New (and What’s Next) for Data Orchestration

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

article thumbnail

The Role of AI in Shaping the Future of Work

KDnuggets

Rather than fearing AI, we should see it as a tool that complements human skills, helping professionals focus on high-value work and enhancing job roles.

IT 134
article thumbnail

Global Fishing Watch – Illuminating Vessel Activity On the Open Ocean

ArcGIS

Having fish for dinner tonight? Ever wondered if anyone is monitoring where it's coming from?

IT 118

More Trending

article thumbnail

Empowering Personalized Banking Experiences

databricks

At Zafin , our mission is to help banks modernize their core infrastructure to deliver exceptional, personalized experiences to their customers. To determine.

Banking 111
article thumbnail

What is Artificial Intelligence (AI)?

WeCloudData

Have you noticed how Siri understands your request effortlessly and how Netflix seems to know exactly what you’ll want to watch next? These simple interactions are not magic or coincidence, but are the common application of Artificial Intelligence. AI influences every aspect of our lives. We interact with it every day, whether during exercise, work, […] The post What is Artificial Intelligence (AI)?

IT 52
article thumbnail

Introducing Real-Time Embeddings: Any Model, Any Vector Database—No Code Needed

Confluent

Confluents Create Embeddings Action for Flink helps you generate vector embeddings from real-time data to create a live semantic layer for your AI workflows.

article thumbnail

Battle of the Ducks

Towards Data Science

DuckDB vs Fireducks: the ultimate throwdown Continue reading on Towards Data Science

article thumbnail

Agent Tooling: Connecting AI to Your Tools, Systems & Data

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

article thumbnail

Confluent Champion Maria on the Power of a Motivated Workplace

Confluent

In our latest Confluent Champion, staff solutions engineer Maria Berinde-Tampanariu shares how Confluent fosters a culture of motivation and growth.

article thumbnail

Battle of the Ducks

Towards Data Science

DuckDB vs Fireducks: the ultimate throwdown Continue reading on Towards Data Science