Sat.Aug 22, 2020 - Fri.Aug 28, 2020

article thumbnail

Optimized shot-based encodes for 4K: Now streaming!

Netflix Tech

by Aditya Mavlankar , Liwei Guo , Anush Moorthy and Anne Aaron Netflix has an ever-expanding collection of titles which customers can enjoy in 4K resolution with a suitable device and subscription plan. Netflix creates premium bitstreams for those titles in addition to the catalog-wide 8-bit stream profiles¹. Premium features comprise a title-dependent combination of 10-bit bit-depth, 4K resolution, high frame rate (HFR) and high dynamic range (HDR) and pave the way for an extraordinary viewing

Media 135
article thumbnail

Most important tools for Data Engineers

Team Data Science

There are a huge number of tools and platforms for data engineers. It's this enormous selection that makes it difficult for newcomers to filter out the really important tools. In the course of the Data Engineer Coaching I was able to gain important experience in this regard and would like to tell you the most important tools on this basis today! During the coaching sessions I saw that a lot of tools keep coming up all the time: Kafka, Spark and AWS.

article thumbnail

The Future Of The Telco Industry And Impact Of 5G & IoT – Part II

Cloudera

In part 2 of the series focusing on the impact of evolving technology on the telecom industry, we sat down with Vijay Raja, Director of Industry & Solutions Marketing at Cloudera to get his views on how the sector is changing and where it goes next. Hi Vijay, thank you so much for joining us again. To continue where we left off, as industry players continue to shift toward a more 5G centric network, how is 5G impacting the industry from a data perspective?

article thumbnail

Use of Modeling and Simulation for Understanding COVID-19 Dynamics

Teradata

This post presents a simulation framework that leverages several mathematical models to simulate the spread of diseases such as COVID-19 in urban environments.

113
113
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

An Overview of Confluent Cloud Security Controls

Confluent

Whether you are a developer working on a cool new real-time application or an architect formulating the plan to reap the benefits of event streaming for the organisation, the subject […].

Cloud 105
article thumbnail

Metadata Management And Integration At LinkedIn With DataHub

Data Engineering Podcast

Summary In order to scale the use of data across an organization there are a number of challenges related to discovery, governance, and integration that need to be solved. The key to those solutions is a robust and flexible metadata management system. LinkedIn has gone through several iterations on the most maintainable and scalable approach to metadata, leading them to their current work on DataHub.

Metadata 100

More Trending

article thumbnail

Digitalizing Energy: A Cure-All Salve or Expensive Placebo?

Teradata

No operator ever made, or ever will make, a single cent or penny from purely digitizing and then storing data – they need to do something with it! Find out how.

IT 98
article thumbnail

Best of Kafka Summit 2020 Roundup

Confluent

If you know me, you know two things: first, that I am committed to remote work as an effective way to build a company; I’ve been a remote employee for […].

Kafka 105
article thumbnail

Eta-Expansion and Partially Applied Functions in Scala

Rock the JVM

Explore the intriguing world of eta-expansion: Discover how methods and functions interact in Scala, revealing insights that can elevate your coding game

Scala 52
article thumbnail

The Advantages Of Live Data-Streaming In The Competitive Financial Services Sector (Part II)

Cloudera

Live data-streaming offers businesses exciting new opportunities to transform the way they operate, leveraging real-time insights to drive better decision making and enhance operational efficiency. To find out more about how live-streaming data might impact the financial services sector, I sat down for a chat with Dinesh Chandrasekhar, Head of Product Marketing in Cloudera’s data-in-motion Business Unit.

Banking 89
article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Will a Few Milliseconds Ruin Your Analytics Performance in the Cloud?

Teradata

Learn why milliseconds of WAN network latency can wreak havoc on performance for analytics in the cloud. Read more.

Cloud 66
article thumbnail

Project Metamorphosis Month 5: Global Event Streaming in Confluent Cloud

Confluent

This is the fifth month of Project Metamorphosis: an initiative that addresses the manual toil of running Apache Kafka® by bringing the best characteristics of modern cloud-native data systems to […].

Project 93
article thumbnail

Type-Level Programming in Scala: Part 3 - Sorting Lists

Rock the JVM

The final chapter in our type-level trilogy: mastering list sorting at compile time

Scala 52
article thumbnail

Building an effective data approach in a hybrid cloud world – part 2

Cloudera

In the last blog with Deloitte’s Marc Beierschoder, we talked about what the hybrid cloud is, why it can benefit a business and what the key blockers often are in implementation. You can read it here. . Today we are continuing our discussion with Martin Mannion , EMEA Big Data Community lead at Deloitte and Paul Mackay, the EMEA Cloud Lead at Cloudera to look at why security and governance requirements must be tackled in the early stages of data-led use case development, thereby mitigating more

Cloud 84
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

So You Think You’ve Got a Data Strategy?

Teradata

Data is the new battleground for banks; yet for all the talk about digitalization, most banks still do not have a coherent enterprise-wide strategy for data.

Banking 52
article thumbnail

Kafka Summit 2020: Day 1 Recap

Confluent

Here is what happened on day one of the event—spoiler alert: My first Summit was awesome. This year’s Kafka Summit is my first and I’ve been lucky to have a […].

Kafka 85
article thumbnail

Type-Level Programming in Scala: Part 3 - Sorting Lists

Rock the JVM

The final chapter in our type-level trilogy: mastering list sorting at compile time

Scala 52
article thumbnail

Production ML Capabilities Now Available In CDSW 1.8

Cloudera

Introducing Model Monitoring & Metrics Store In Cloudera Data Science Workbench. With only about 35% of machine learning models making into production in the enterprise ( IDC ), it’s no wonder that production machine learning has become one of the most important focus areas for data scientists and ML engineers alike. As you may remember, we recently announced a full set of MLOps capabilities in Cloudera Machine Learning , our cloud native machine learning tool for the cloud.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Case Study: Matter Uses Rockset to Bring AI-Powered Sustainable Insights to Investors

Rockset

The effects of climate change and inequality are threatening societies across the world, but there is still an annual funding gap of US$2.5 trillion to achieve the UN Sustainable Development Goals by 2030. A substantial amount of that money is expected to come from private sources like pension funds, but institutional investors often struggle to efficiently incorporate sustainability into their investment decisions.

NoSQL 40
article thumbnail

How to Format Zendesk Tags

Grouparoo

In the process of integrating Grouparoo with Zendesk , I searched the documentation for the right way to format tags, but was unable to find it. I thought I'd write up a guide to help others on the same journey. In case you are "that person" and just want the answer, here it is: Tags needs to be lowercase and not have any spaces. You can have underscores.

article thumbnail

The Role Of Technology In A Changing Financial Services Sector Part II

Cloudera

Evaluating anomalies and unpredicted events like pandemics and ESG concerns. In part II of the series, we sat down for an interview with Dr. Richard Harmon, Managing Director of Financial Services at Cloudera, to find out more about how the industry is adopting new technology. You can catch-up and read part 1 of the series, here. Thank you for joining us for part two of our discussion around data, analytics and machine learning within the Financial Service Sector Dr.

article thumbnail

Handling Slow Queries in MongoDB - Part 2: Solutions

Rockset

In Part One , we discussed how to first identify slow queries on MongoDB using the database profiler, and then investigated what the strategies the database took doing during the execution of those queries to understand why our queries were taking the time and resources that they were taking. In this blog post, we’ll discuss several other targeted strategies that we can use to speed up those problematic queries when the right circumstances are present.

MongoDB 40
article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Certified technical partner solutions help customers succeed with Cloudera Data Platform

Cloudera

On August 18, we completed our Enterprise Data Cloud vision of bringing a truly hybrid cloud experience with the general availability of Cloudera Data Platform Private Cloud (CDP Private Cloud). CDP Private Cloud, which is based on Kubernetes (RedHat OpenShift), extends cloud-native speed, simplicity and economics for the connected data lifecycle to the on-prem world, enabling IT to respond to business needs faster and deliver rock-solid service levels so people can be more productive with data.