February, 2017

article thumbnail

Apache Airflow and the Future of Data Engineering: A Q&A

Maxime Beauchemin

With a brief Introduction and Takeaway added by Taylor D. Edmiston Introduction Every once in a while I read a post about the future of tech that resonates with clarity. A few weeks ago it was The Rise of the Data Engineer by Maxime Beauchemin, a data engineer at Airbnb and creator of their data pipeline framework, Apache Airflow. At Astronomer, Apache Airflow is at the very core of our tech stack : our integration workflows are defined by data pipelines built in Apache Airflow as directed acycl

article thumbnail

Evolving Distributed Tracing at Uber Engineering

Uber Engineering

Distributed tracing is quickly becoming a must-have component in the tools that organizations use to monitor their complex, microservice-based architectures. At Uber Engineering, our open source distributed tracing system Jaeger saw large-scale internal adoption throughout 2016, integrated into hundreds … The post Evolving Distributed Tracing at Uber Engineering appeared first on Uber Engineering Blog.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Zalenium: A Disposable and Flexible Selenium Grid Infrastructure

Zalando Engineering

Engineering Productivity is an area in Zalando where our main goal is to help other teams test their products by providing great tools and services. For UI testing execution, we offer teams a mix of internal and external tools. Some teams use docker-selenium , a dockerized Selenium Grid, and other teams use Sauce Labs. Each tool has its own advantages and disadvantages, but they fulfill our needs and complement each other.

Cloud 52
article thumbnail

Recap of Hadoop News for January 2017

ProjectPro

News on Hadoop-January 2017 Big Data In Gambling: How A 360-Degree View Of Customers Helps Spot Gambling Addiction. Forbes.com, January 5, 2017. The largest gaming agency in Finland, Veikkaus is using big data to build a 360 degree picture of its customers. Veikkaus merged with Fintoto(Horse Racing) and Ray(Slots and Casinos) in January 2017 to become the largest gaming organization in Europe.

Hadoop 52
article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

How the Zalando iOS App Abandoned CocoaPods and Reduced Build Time

Zalando Engineering

Dependency management doesn’t have to be complicated. The current dependency managers for iOS are CocoaPods , which is the de facto standard tool, Carthage , and Swift Package Manager. Despite the range of automated solutions, we found at Zalando that manual management brings about better performance and doesn’t require much maintenance in a big, modular project.

article thumbnail

Dress Code: An In-house Style Guide for Zalando’s Solution Center

Zalando Engineering

Saying the design team in Zalando has grown in the last few years would be an understatement: it has exploded, jumping from around 10 to over 40 designers in an 18-month period. With this comes many challenges, one of which is making sure our interfaces stay coherent and cohesive, no matter who designed or coded it. Dress Code is a pattern library and style guide created by the Brand Solutions Central Services team to address these issues in the scope of Zalando’s Solution Center – a central rep

Coding 40

More Trending

article thumbnail

Emerging Big Data Trends for 2023

ProjectPro

"Data and analytics are already shaking up multiple industries, and the effects will only become more pronounced as adoption reaches critical mass.” said the McKinsey Global Institute (MGI) in its executive overview of last month's report: "The Age of Analytics: Competing in a Data-Driven World." 2016 was an exciting year for big data with organizations developing real-world solutions with big data analytics making a major impact on their bottom line. 2017 will see a continuation of these

article thumbnail

Building a Relay-compatible GraphQL Server

Zalando Engineering

You’ve probably heard about GraphQL and Relay , and how they will change everything we know about data management in our applications. At Zalando, we’re open to experimenting with and adding to our technology stack, and this is no exception. In this article I’d like to shed some light on Relay’s internals and build a GraphQL server on top of the existing Zalando REST API , making it compatible with Relay.

article thumbnail

Using Microservices to Power Fashion Search and Discovery

Zalando Engineering

Microservices became a design style to define system architectures, purify core business concepts, evolve solutions in parallel, make things look uniform, and implement stable and consistent interfaces across systems. At Zalando, we’ve been putting together a series of articles that explain how we are applying microservice patterns to our applications: Fashion Store , Skipper , and Mosaic.