Tue.Dec 17, 2024

article thumbnail

Part 1: A Survey of Analytics Engineering Work at Netflix

Netflix Tech

This article is the first in a multi-part series sharing a breadth of Analytics Engineering work at Netflix, recently presented as part of our annual internal Analytics Engineering conference. We kick off with a few topics focused on how were empowering Netflix to efficiently produce and effectively deliver high quality, actionable analytic insights across the company.

article thumbnail

Telco Enterprise Data Platforms: Key Success Factors in Building for an AI Future

Cloudera

Since 5G networks began rolling out commercially in 2019, telecom carriers have faced a wide range of new challenges: managing high-velocity workloads, reducing infrastructure costs, and adopting AI and automation. Because data management is a key variable for overcoming these challenges, carriers are turning to hybrid cloud solutions, which provide the flexibility and scalability needed to adapt to the evolving landscape 5G enables.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Title Launch Observability at Netflix Scale

Netflix Tech

Part 1: Understanding The Challenges By: VarunKhaitan With special thanks to my stunning colleagues: Mallika Rao , Esmir Mesic , HugoMarques Introduction At Netflix, we manage over a thousand global content launches each month, backed by billions of dollars in annual investment. Ensuring the success and discoverability of each title across our platform is a top priority, as we aim to connect every story with the right audience to delight our members.

article thumbnail

Using JSpecify 1.0 to Tame Nulls in Java by Magnus Smith

Scott Logic

Introduction In the Java ecosystem, dealing with null values has always been a source of confusion and bugs. A null value can represent various states: the absence of a value, an uninitialized object, or even an error. However, there has never been a consistent, standardized approach for annotating and ensuring null-safety at the language level. Nullability annotations like @Nullable and @NonNull are often used, but theyre not part of the core Java language, leading to inconsistencies across lib

Java 52
article thumbnail

A Guide to Debugging Apache Airflow® DAGs

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

article thumbnail

How GenAI is Transforming Quality Control and Safety in the F&B Industry.

RandomTrees

The food and beverage (F&B) sector is constantly under pressure to comply with strict food safety compliance while also ensuring that operations run efficiently. In light of rapid changes in consumer demand, policies, and supply chain management, there is an urgent need to utilize new technologies. Generative AI (GenAI), an area of artificial intelligence, is enhancing the automation of quality control processes, thereby increasing the safety and efficiency of the industry.

Food 52
article thumbnail

Introducing Git Support for Queries in Databricks

databricks

Were excited to announce the Public Preview of Query Git integration as part of the new SQL Editor. Git support for queries.

SQL 126

More Trending

article thumbnail

Benchmarking Domain Intelligence

databricks

Large language models are improving rapidly; to date, this improvement has largely been measured via academic benchmarks. These benchmarks, such as MMLU and.

116
116
article thumbnail

Multimodal RAG Implementation with Hugging Face

KDnuggets

Learn how to enhance RAG models by combining text and visual inputs using Hugging Face Transformers.

120
120
article thumbnail

Databricks at NRF 2025: The future of retail runs on the Data Intelligence Platform

databricks

Book at meeting wtih Databricks at NRF 2025! As we approach January 2025, the retail industry is gearing up for another groundbreaking Retail's.

Retail 98
article thumbnail

Unwrap ArcGIS Pro Summary Statistics Enhancements this Holiday Season (Dec 2024)

ArcGIS

In ArcGIS Pro 3.4, the Summary Statistics tool includes DBMS Statistics for faster performance for data from remote databases.

article thumbnail

Mastering Apache Airflow® 3.0: What’s New (and What’s Next) for Data Orchestration

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

article thumbnail

Generate More Insight By Connecting GameAnalytics to Databricks

databricks

Were excited to announce a joint effort between Databricks for Games and GameAnalytics. This blog and associated code will help our mutual customers.

Coding 96
article thumbnail

Cloud Efficiency at Netflix

Netflix Tech

By J Han , PallaviPhadnis Context At Netflix, we use Amazon Web Services (AWS) for our cloud infrastructure needs, such as compute, storage, and networking to build and run the streaming platform that we love. Our ecosystem enables engineering teams to run applications and services at scale, utilizing a mix of open-source and proprietary solutions. In turn, our self-serve platforms allow teams to create and deploy, sometimes custom, workloads more efficiently.

Cloud 83
article thumbnail

Seven West Media: Pioneering the Future of Personalized Digital Engagement

databricks

Seven West Medias 7plus is one of Australias leading streaming platforms for broadcast VOD (video on demand), enabling audiences to livestream broadcast content.

Media 52
article thumbnail

Celebrating a Busy Week of Giving at Cloudera

Cloudera

In November, Cloudera celebrated its third annual Week of Giving, one of the companys most cherished initiatives. Each year, this event is a time for Clouderans across the globe to join in and spend time giving back to the causes they care about. From partnering with a nonprofit organization to gathering donations or volunteering their time, Clouderans rolled up their sleeves to give back to their communities.

Food 68
article thumbnail

Agent Tooling: Connecting AI to Your Tools, Systems & Data

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

article thumbnail

Summary of the Gartner Presentation: “How Can You Leverage Technologies to Solve Data Quality Challenges?”

DataKitchen

The Gartner presentation, How Can You Leverage Technologies to Solve Data Quality Challenges? by Melody Chien, underscores the critical role of data quality in modern business operations. High-quality data is the blood that sustains the organizational value chainimpacting everything from logistics to services, sales, and marketing. Poor data quality, on average, costs organizations $12.9 million annually , or 7% of their total revenue.

article thumbnail

Spreading Holiday Cheer at Picnic

Picnic Engineering

The holiday season is always special at Picnic! In this blog post we will take you on our journey to bring Christmas spirit to Picnic. In detail we will dive into how we decorated all our systems and how we bring every single day some new puzzle engineering fun to all our engineers. Advent ofCode Advent of Code is a series of small programming challenges that runs every December.