Data Engineering Podcast

MARCH 4, 2019

Summary Customer analytics is a problem domain that has given rise to its own industry. In order to gain a full understanding of what your users are doing and how best to serve them you may need to send data to multiple services, each with their own tracking code or APIs. To simplify this process and allow your non-engineering employees to gain access to the information they need to do their jobs Segment provides a single interface for capturing data and routing it to all of the places that you

Google Cloud 100

Google Cloud Kafka Media Data Warehouse 100

Uber Engineering

MARCH 8, 2019

First introduced by Uber in November 2018, Peloton , a unified resource scheduler, manages resources across distinct workloads, combining separate compute clusters. Peloton is designed for web-scale companies like Uber with millions of containers and tens of thousands of nodes. … The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog.

Engineering 109

Engineering Designing Management Architecture 109

Confluent

MARCH 4, 2019

Cloud is one of the key drivers for innovation. Innovative companies experiment with data to come up with something useful. It usually starts with the opening of a firehose that continuously broadcasts tons of events before they start mining it to create music out of simply noise. Today, companies from all around the world are witnessing an explosion of event generation coming from everywhere, including their own internal systems.

Cloud 89

Cloud Banking Kafka NoSQL 89

Netflix Tech

MARCH 5, 2019

Netflix’s engineering culture is predicated on Freedom & Responsibility, the idea that everyone (and every team) at Netflix is entrusted with a core responsibility and they are free to operate with freedom to satisfy their mission. This freedom allows teams and individuals to move fast to deliver on innovation and feel responsible for quality and robustness of their delivery.

Cloud 73

Cloud Building Amazon Web Services Metadata 73

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

Pandora Engineering

MARCH 6, 2019

It’s 7 o’clock. I tug my blanket tightly over my face, hoping to whisk the morning away. The sound of my favorite playlist soothes me to a gentle rise. I smile. The alarm worked. Months of hard work collaborating with Google™, including many days at each others’ offices, came to life in that moment. Just a week earlier, we announced the release of the Pandora integration with the Clock app from Google.

Media 52

Media Architecture Engineering Algorithm 52

Uber Engineering

MARCH 7, 2019

Reliability engineering teams at Uber build the tools, libraries, and infrastructure that enable engineers to operate our thousands of microservices reliably at scale. At its essence, reliability engineering boils down to actively preventing outages that affect the mean time between … The post Using Machine Learning to Ensure the Capacity Safety of Individual Microservices appeared first on Uber Engineering Blog.

Machine Learning 105

Machine Learning Engineering Building IT 105

Teradata

MARCH 4, 2019

Find out how data scientists can contribute to solving real-life business problems, as well as how Teradata Vantage can help data scientists enable a better ROI for their company.

Data 49

Data 49

Domino Data Lab: Data Engineering

MARCH 2, 2019

Paco Nathan covers recent research on data infrastructure as well as adoption of machine learning and AI in the enterprise.

Machine Learning 52

Machine Learning Deep Learning Data Data Science 52

Netflix Tech

MARCH 6, 2019

FlameScope sub-second heatmap visualization. Less than a year ago, FlameScope was released as a proof of concept for a new profile visualization. Since then, it helped us, and many other users, to easily find and fix performance issues, and allowed us to see patterns that we had never noticed before in our profiles. As a tool, FlameScope was limited.

Programming Language 40

Programming Language Coding Programming Cloud 40

Teradata

MARCH 7, 2019

Teradata CEO Oliver Ratzesberger celebrates International Women's Day.

Building 69

Building 69

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

Netflix Tech

MARCH 6, 2019

MezzFS?—?Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. It’s used extensively in our media processing platform, which includes services like Archer and runs features like video encoding and title image generation on tens of thousands of Amazon EC2 instances.

Media 86

Media Bytes Process Accessible 86

Netflix Tech

MARCH 7, 2019

Design Principles for Mathematical Engineering in Experimentation Platform at Netflix Jeffrey Wong, Senior Modeling Architect, Experimentation Platform Colin McFarland, Director, Experimentation Platform At Netflix, we have data scientists coming from many backgrounds such as neuroscience, statistics and biostatistics, economics, and physics; each of these backgrounds has a meaningful contribution to how experiments should be analyzed.

Designing 69

Designing Engineering Data Science Python 69