November, 2016

article thumbnail

Dockerizing MySQL at Uber Engineering

Uber Engineering

Uber Engineering’s Schemaless storage system powers some of the biggest services at Uber, such as Mezzanine. Schemaless is a scalable and highly available datastore on top of MySQL ¹ clusters. Managing these clusters was fairly easy when we had … The post Dockerizing MySQL at Uber Engineering appeared first on Uber Engineering Blog.

MySQL 111
article thumbnail

The State of Frontend at Zalando 2016

Zalando Engineering

After seeing the State of JavaScript survey make headway online, we thought it would be interesting to do the same for Zalando to get a better understanding about what technologies and frameworks we’re using here. For the JavaScript survey, participating developers answered questions on topics ranging from frontend frameworks and state management, to build tools and testing libraries.

article thumbnail

What career path should I take to become a Hadoop Developer?

ProjectPro

Having worked your way up in the IT totem pole in the same job role, you have decided this is the best to find new horizons, new environment and a new gig in the big data domain. Starting a new career is exciting but it is not easy as lot of analysis goes into choosing a new career path. Let’s help you out with some detailed analysis on the career path taken by hadoop developers so you can easily decide on the career path you should follow to become a Hadoop developer.

Hadoop 52
article thumbnail

The RecSys’16 Review

Zalando Engineering

This year was RecSys’ 10th anniversary, and we were lucky enough to be in attendance. The evolution of the conference is great to see – it has grown from a mid-size event beginning in 2009, to an ever-sold-out conference in the past few years, with one of the bests mixes of industry and academia you can find. It also has an open and welcoming community, where the standard of work being presented is incredibly high.

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Doing Data Science the Cloud and Distributed Way

Zalando Engineering

Our team have been building data science products together for almost one year now. We believe that data scientists and data engineers should work closely together, yet we understand the differences in the environments and tasks that each of us perform. In this vein, we have iterated the way we do data science, specially early stage exploratory data science with large datasets.

article thumbnail

Crafting Effective Microservices in Python

Zalando Engineering

TL;DR: The API-first approach combined with Connexion are powerful tools to create effective microservices. The use of API-first brings the benefit of creating APIs that fulfil the expectations of your clients. Besides that, using Connexion will help you develop APIs in Python in a smooth manner. Google’s acquisition of Apigee emphasises how important APIs are in today’s architecture of applications.

Python 40

More Trending

article thumbnail

A Closer Look at Elasticsearch Express

Zalando Engineering

Elasticsearch is a technology that has been gaining popularity lately at Zalando Tech. We’ve learned that it’s a state of the art tool, and in the hands of a data artist can be used to design data models to conquer information retrieval challenges at a very large scale in a performant, distributed manner. The success of Elasticsearch as a technology is due to the various use cases it fits.

AWS 40
article thumbnail

Bread&Butter 2016: The Livestreaming Rollercoaster

Zalando Engineering

The fashion industry has been dominated by the elite for decades. Access to top products and brands were once restricted, while trendsetters were the only people on the guest list for the hottest events. Zalando wants to open up this world and grant greater access, reduce barriers, and empower customers. Zalando’s vision is to connect people and fashion.

Media 40
article thumbnail

The Art of Mob Programming

Zalando Engineering

As a Producer at Zalando, our roles are instrumental in supporting development teams achieve excellence when delivering software. We help them by creating an environment where every team member can give their best. A few months ago, I read an article written by Woody Zuill about Mob Programming , a fairly new concept based on how we approach teamwork in software development.

article thumbnail

Why Did I Decide to Become a Producer?

Zalando Engineering

It may sound like a cliche, but I love working with people – especially engineers. The energy, creativity, and innovation that comes out of the software development process is like a never ending tank of fuel. Producers at Zalando are the organizational engines of their teams. We’re responsible for managing product releases, external project dependencies and deliverables, as well as refining requirements, features, and user stories.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

How InnerSource bolstered integration for Local Order Fulfillment

Zalando Engineering

Our tech organization is always looking for ways to improve its systems and processes – we’re constantly striving to be better. To increase team autonomy and improve delivery time, we’re currently piloting InnerSource, a development approach that applies open source principles to the way companies develop software internally. Our initial pilot of the approach focused on teams working within product clusters whose work presented opportunities for cross-collaboration.

Retail 40
article thumbnail

Angular2: Final Release Unit Test Migration Guide

Zalando Engineering

I am not a fan of the Angular-way in Angular1, as I think it looks rather strange. Nevertheless, Angular2 gives a much better impression in terms of code structure, code purity, and scalability. While they didn’t reinvent the wheel, its creators have built something interesting and spectacular that stacks up well against modern frameworks (React and Redux, Aurelia, etc.).

article thumbnail

Hadoop Architecture Explained-What it is and why it matters

ProjectPro

Understanding the Hadoop architecture now gets easier! This blog will give you an indepth insight into the architecture of hadoop and its major components- HDFS, YARN, and MapReduce. We will also look at how each component in the Hadoop ecosystem plays a significant role in making Hadoop efficient for big data processing. Table of Contents Hadoop Architecture - The Inception How do Businesses Leverage the Hadoop Application Architecture?

Hadoop 40
article thumbnail

Bootcamp for Fashpreneurs – Reimagining Online Fashion

Zalando Engineering

As Europe's largest online fashion platform with a vision to connect all players in the fashion business, we want to open up even more to the startup community by doing what we know – encouraging the next generation of fashpreneurs to scale tech in fashion. There is an ocean of opportunity out there, from the latest developments in AR/VR technology to the new wave of content creators shaking up the brand game.

article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Delivering a Cross-Site Project

Zalando Engineering

You may have heard recently from one of the many media outlets about the launch of Collabary , the content creator platform from Zalando. This showcases the perfect merger of enriched data with a high quality frontend application. In this blog post I’d like to give my lessons learnt from being part of the team involved in this project, based here in Dublin.

Project 40
article thumbnail

The Sprint Exposed – How we Use it at Zalando

Zalando Engineering

The Design Sprint (or just The Sprint) is the process introduced by Google Ventures and Jake Knapp, author of “ The Sprint ”. The main method idea is to answer the most critical project questions and doubts in just one week. There’s no endless brainstorming sessions, no coding – just short, highly energetic activities that push your product forward.

IT 40
article thumbnail

Recap of Hadoop News for October

ProjectPro

News on Hadoop-October 2016 Microsoft upgrades Azure HDInsight, its Hadoop Big Data offering.SiliconAngle.com,October 2, 2016. Microsoft and Hortonworks Inc. product Azure HDInsight is a managed Hadoop service that gives users access to deploy and manage hadoop clusters on the Azure Cloud. Microsoft has upgraded this cloud based platform with new security enhancements and a performance boost that the company states will speed up Big Data queries 25x.

Hadoop 40