Data Engineering Podcast

DECEMBER 10, 2017

Summary To process your data you need to know what shape it has, which is why schemas are important. When you are processing that data in multiple systems it can be difficult to ensure that they all have an accurate representation of that schema, which is why Confluent has built a schema registry that plugs into Kafka. In this episode Ewen Cheslack-Postava explains what the schema registry is, how it can be used, and how they built it.

Kafka 100

Kafka Data Pipeline Data Engineer Data Engineering 100

Zalando Engineering

DECEMBER 13, 2017

How effective management is a continuing story of growth Producers’ Style One of the things I struggled the most with in the past year was identifying the best way to lead my teams. I worked a lot on myself, observed my peers, and tried to learn from my leads, but in the end, I ran into into the well known dilemma: task-focused or people-focused management, which one is best?

Management 52

Management Building Process Project 52

Cloudera

DECEMBER 14, 2017

The Apache Hadoop community recently released version 3.0.0 GA , the third major release in Hadoop’s 10-year history at the Apache Software Foundation. We covered earlier releases like 3.0.0-alpha1 and 3.0.0-alpha2 on the Cloudera Engineering blog, and 3.0.0 GA is bigger and better than ever. General availability (GA) marks a point of quality and stability for the release series that indicates it’s ready for broader use.

Hadoop 42

Hadoop Cloud Storage Data Lake Software Engineer 42

Cloudera

DECEMBER 15, 2017

Manufacturing as an industry has always been at the forefront of squeezing value from data. Instrumentation, highly connected systems, and automation have been part and parcel of manufacturing organisations for decades. Constrained by the state of technology more than cost, process optimisation was always achieved by making clever use of the data available and has given rise to completely new disciplines and applications.

Manufacturing 40

Manufacturing Machine Learning Structured Data Process 40

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Cloudera

DECEMBER 12, 2017

From left to right: Nirupama Kamat, Anne Smith, Aimee Schneider, Wendi Durnin, Britt Sellin, Saketa Chandra Chalamchala, Josh Blackburn, Mike Olson, Kathy Erickson, Hilary Mason, Lauren Tipton. Not pictured: Kathyrn Hirsch. Mike Olson, Amr Awadallah, and the rest of Cloudera’s early leaders laid the foundation for a culture of respect, openness, and inclusion from day one.

Recruitment 40

Recruitment Programming Designing Building 40

Cloudera

DECEMBER 11, 2017

. First they came for the Socialists, and I did not speak out—. Because I was not a Socialist. Then they came for the Trade Unionists, and I did not speak out—. Because I was not a Trade Unionist. Then they came for the Jews, and I did not speak out—. Because I was not a Jew. Then they came for me—and there was no one left to speak for me. Most of you will likely be familiar with some version of this poem.

Media 40

Media Government Portfolio Education 40