Data Engineering Podcast

APRIL 14, 2018

Summary The rate of change in the data engineering industry is alternately exciting and exhausting. Joe Crobak found his way into the work of data management by accident as so many of us do. After being engrossed with researching the details of distributed systems and big data management for his work he began sharing his findings with friends. This led to his creation of the Hadoop Weekly newsletter, which he recently rebranded as the Data Engineering Weekly newsletter.

Data Engineer 100

Data Engineer Data Engineering Engineering Hadoop 100

Zalando Engineering

APRIL 18, 2018

Using Akka cluster-sharding and Akka HTTP on Kubernetes This article captures the implementation of an application serving data over HTTP which is stored in cluster-sharded actors and deployed on Kubernetes. Use case: An application, serving data over HTTP and with a high request rate, and the latency of order of 10ms with limited database IOPS available.

Metadata 40

Metadata Database Coding Systems 40

Zalando Engineering

APRIL 16, 2018

How data science is becoming available ‘for the good of all’ businesses In his 2010 Ted Talk “ When Ideas Have Sex ,” Matt Ridley posits that human prosperity was caused by one thing and one thing only; our unique human ability to specialise and exchange ideas and tools. Ridley’s example of the invention of the reading light illustrates how far we’ve come.

Data Science 52

Data Science Deep Learning Datasets Data 52