Maxime Beauchemin

FEBRUARY 28, 2017

With a brief Introduction and Takeaway added by Taylor D. Edmiston Introduction Every once in a while I read a post about the future of tech that resonates with clarity. A few weeks ago it was The Rise of the Data Engineer by Maxime Beauchemin, a data engineer at Airbnb and creator of their data pipeline framework, Apache Airflow. At Astronomer, Apache Airflow is at the very core of our tech stack : our integration workflows are defined by data pipelines built in Apache Airflow as directed acycl

Data Engineer 130

Data Engineer Data Engineering Engineering Data Pipeline 130

Uber Engineering

FEBRUARY 2, 2017

Distributed tracing is quickly becoming a must-have component in the tools that organizations use to monitor their complex, microservice-based architectures. At Uber Engineering, our open source distributed tracing system Jaeger saw large-scale internal adoption throughout 2016, integrated into hundreds … The post Evolving Distributed Tracing at Uber Engineering appeared first on Uber Engineering Blog.

Engineering 110

Engineering Architecture Systems Scala 110

Zalando Engineering

FEBRUARY 13, 2017

Engineering Productivity is an area in Zalando where our main goal is to help other teams test their products by providing great tools and services. For UI testing execution, we offer teams a mix of internal and external tools. Some teams use docker-selenium , a dockerized Selenium Grid, and other teams use Sauce Labs. Each tool has its own advantages and disadvantages, but they fulfill our needs and complement each other.

Cloud 52

Cloud Project Engineering IT 52

ProjectPro

FEBRUARY 1, 2017

News on Hadoop-January 2017 Big Data In Gambling: How A 360-Degree View Of Customers Helps Spot Gambling Addiction. Forbes.com, January 5, 2017. The largest gaming agency in Finland, Veikkaus is using big data to build a 360 degree picture of its customers. Veikkaus merged with Fintoto(Horse Racing) and Ray(Slots and Casinos) in January 2017 to become the largest gaming organization in Europe.

Hadoop 52

Hadoop MongoDB Big Data Kafka 52

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Zalando Engineering

FEBRUARY 21, 2017

Dependency management doesn’t have to be complicated. The current dependency managers for iOS are CocoaPods , which is the de facto standard tool, Carthage , and Swift Package Manager. Despite the range of automated solutions, we found at Zalando that manual management brings about better performance and doesn’t require much maintenance in a big, modular project.

Building 40

Building Coding Project Management 40

Zalando Engineering

FEBRUARY 20, 2017

Saying the design team in Zalando has grown in the last few years would be an understatement: it has exploded, jumping from around 10 to over 40 designers in an 18-month period. With this comes many challenges, one of which is making sure our interfaces stay coherent and cohesive, no matter who designed or coded it. Dress Code is a pattern library and style guide created by the Brand Solutions Central Services team to address these issues in the scope of Zalando’s Solution Center – a central rep

Coding 40

Coding Designing Retail Project 40

ProjectPro

FEBRUARY 8, 2017

"Data and analytics are already shaking up multiple industries, and the effects will only become more pronounced as adoption reaches critical mass.” said the McKinsey Global Institute (MGI) in its executive overview of last month's report: "The Age of Analytics: Competing in a Data-Driven World." 2016 was an exciting year for big data with organizations developing real-world solutions with big data analytics making a major impact on their bottom line. 2017 will see a continuation of these

Big Data 40

Big Data Hadoop Data Lake Machine Learning 40

Zalando Engineering

FEBRUARY 2, 2017

You’ve probably heard about GraphQL and Relay , and how they will change everything we know about data management in our applications. At Zalando, we’re open to experimenting with and adding to our technology stack, and this is no exception. In this article I’d like to shed some light on Relay’s internals and build a GraphQL server on top of the existing Zalando REST API , making it compatible with Relay.

Building 40

Building Coding Accessibility Accessible 40

Zalando Engineering

FEBRUARY 1, 2017

Microservices became a design style to define system architectures, purify core business concepts, evolve solutions in parallel, make things look uniform, and implement stable and consistent interfaces across systems. At Zalando, we’ve been putting together a series of articles that explain how we are applying microservice patterns to our applications: Fashion Store , Skipper , and Mosaic.

Data Mining 40

Data Mining Metadata Retail Algorithm 40