Tue.Nov 12, 2024

article thumbnail

15+ Companies Using DuckDB in Production: A Comprehensive Guide

Simon Späti

From Fortune 500 companies processing trillions of security records to innovative startups building interactive data tools, DuckDB is revolutionizing how organizations handle analytical workloads. Building on our exploration of DuckDB’s core capabilities in Part 1 , this guide showcases production implementations and promising experimental applications across five key categories.

article thumbnail

How Data Teams Drive Business Success by Understanding Core Metrics

Seattle Data Guy

A key responsibility for any data team is to understand the core metrics driving their business. Starting from the top, these metrics often include figures like gross revenue and expenses. However, these high-level metrics can feel too far removed and abstract from the actual business. Many companies, therefore, break down these top-line metrics into more… Read more The post How Data Teams Drive Business Success by Understanding Core Metrics appeared first on Seattle Data Guy.

Data 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Using Pandas and SQL Together for Data Analysis

KDnuggets

In this tutorial, we’ll explore when and how SQL functionality can be integrated within the Pandas framework, as well as its limitations.

SQL 126
article thumbnail

They Handle 500B Events Daily. Here’s Their Data Engineering Architecture.

Monte Carlo

A data engineering architecture is the structural framework that determines how data flows through an organization – from collection and storage to processing and analysis. It’s the big blueprint we data engineers follow in order to transform raw data into valuable insights. Before building your own data architecture from scratch though, why not steal – er, learn from – what industry leaders have already figured out?

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

AI Agent Systems: Modular Engineering for Reliable Enterprise AI Applications

databricks

Monolithic to Modular The proof of concept (POC) of any new technology often starts with large, monolithic units that are difficult to characterize.

Systems 105
article thumbnail

Netflix’s Distributed Counter Abstraction

Netflix Tech

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction. This counting service, built on top of the TimeSeries Abstraction, enables distributed counting at scale while maintaining similar low latency performance.

More Trending

article thumbnail

How Meta built large-scale cryptographic monitoring

Engineering at Meta

Cryptographic monitoring at scale has been instrumental in helping our engineers understand how cryptography is used at Meta. Monitoring has given us a distinct advantage in our efforts to proactively detect and remove weak cryptographic algorithms and has assisted with our general change safety and reliability efforts. We’re sharing insights into our own cryptographic monitoring system, including challenges faced in its implementation, with the hope of assisting others in the industry aiming to

article thumbnail

The role of AI in changing company structures and dynamics

databricks

The most recent wave of artificial intelligence (AI), spearheaded by the advent and mass adoption of large language models (LLM), showed the potential.

Data 71
article thumbnail

Unmatched Collaboration for Data & AI Products: What’s New

Snowflake

Getting different teams, business units and even companies to work together toward a common goal not only maximizes efficiency, but drives innovation. Effective collaboration on data and AI has never been more closely tied to success. At Snowflake, we’re removing the barriers that prevent productive cooperation while building the connections to make working together easier than ever.

AWS 53
article thumbnail

Triggered Tasks in Snowflake

Cloudyard

Read Time: 2 Minute, 32 Second Triggered tasks in Snowflake offer a key advantage: they only execute when new data arrives, eliminating the need to run a warehouse or cloud service constantly and reducing associated costs. By leveraging Snowflake’s stream processing and trigger-based task scheduling , we ensure data is loaded and validated as soon as it arrives, allowing for near real-time processing.

article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Confluent Champion: Rising Through the Ranks in Security

Confluent

Read our latest Confluent Champion post to learn how security engineering manager Tejal Adsul is honing her leadership skills at Confluent.

article thumbnail

How to Become a Software Engineer (Without a Degree)

KDnuggets

The fastest and simplest route to becoming a software engineer with little cost.