KDnuggets

FEBRUARY 4, 2025

This article explores various strategies for managing outliers to ensure accurate and robust statistical analyses.

Data 87

Data Management 87

Engineering at Meta

FEBRUARY 4, 2025

Were sharing how Meta built support for data logs, which provide people with additional data about how they use our products. Here we explore initial system designs we considered, an overview of the current architecture, and some important principles Meta takes into account in making data accessible and easy to understand. Users have a variety of tools they can use to manage and access their information on Meta platforms.

Accessibility 87

Accessibility Accessible Raw Data Data Warehouse 87

Snowflake

FEBRUARY 4, 2025

AI is here to stay. While 2023 brought wonder and 2024 ushered in widespread experimentation, 2025 will mark the year that retailers get serious about AI's real-world applications. But its complicated: AI proofs of concept are graduating from the sandbox to production even as major AI innovators face competition from newer upstarts. At this point, the pace of AI evolution is outstripping the news cycle.

Retail 94

Retail Deep Learning Technology Designing 94

Sync Computing

FEBRUARY 4, 2025

As data engineers, understanding the intricacies of your Databricks environment is important. You cant optimize performance, budget or ensure efficient resource allocations without it. Thankfully, Databricks gives you a behind-the-scenes look at how your workspace is running in system tables. Everything from query performance to job execution and cluster activity is in those tables.

SQL 52

SQL Datasets Utilities Accessibility 52

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

databricks

FEBRUARY 4, 2025

Databricks welcomes BladeBridge, a proven provider of AI-powered migration solutions for enterprise data warehouses. Together, Databricks and BladeBridge will help enterprises accelerate the.

Data Warehouse 115

Data Warehouse Data 115

Striim

FEBRUARY 4, 2025

Introduction At Striim, we use our Salesforce Reader to read from our Salesforce account and write into Google BigQuery where we join data from HubSpot to create Looker reports that multiple internal teams (Sales, Customer Success and Finance) use for reporting, analysis and drive action items for their departments. This recipe shows how you can build a data pipeline to read data from Salesforce and write to BigQuery.

Building 52

Building Data Pipeline Datasets Finance 52

databricks

FEBRUARY 4, 2025

Dave & Busters Entertainment, Inc. owns and operates over 200 venues in North America that offer premier entertainment and dining experiences to guests.

Entertainment 59

Entertainment Retail 59

Confluent

FEBRUARY 4, 2025

Learn how to integrate Stripe data with Pinecone using the HTTP Source V2 Connector, HTTP Sink V2 Connector and Flink AI in Confluent Cloudfor enhanced real-time fraud detection.

Cloud 59

Cloud Management Data 59

Wayne Yaddow

FEBRUARY 4, 2025

Its EssentialVerifying Data Transformations (Part4) Uncovering the leading problems in data transformation workflowsand practical ways to detect and preventthem In Parts 13 of this series of blogs, categories of data transformations were identified as among the top causes of data quality defects in data pipeline workflows. Other primary causes were reported to result from data ingestion, schema mismatches, and errors in sourceinput.

Data Pipeline 52

Data Pipeline Data Ingestion Data Government 52

Robinhood

FEBRUARY 4, 2025

The Commodity Futures Trading Commission (CFTC) has formally requested that Robinhood Derivatives, LLC (RHD) not permit customers to access sports event contracts. While we continue to work with the CFTC to understand their concerns, we are suspending the rollout of the Pro Football Championship market. We have rolled this product out to roughly 1% of our customers, and for those who already placed trades, we plan on providing the option to close their positions or take them to resolution.

Technology 68

Technology Project Accessibility Accessible 68

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

WeCloudData

FEBRUARY 4, 2025

We hear the terms Artificial Intelligence , Machine Learning , and Data Science almost daily. From facial recognition on the phone, to chatbots like ChatGPT these fields are shaping the future. But do we truly understand the differences between them? Many people use AI, ML, and Data Science interchangeably, but in reality, they serve different […] The post AI vs.

Machine Learning 52

Machine Learning Data Science Data 52