November, 2015

article thumbnail

Building Our Own Open-Source HTTP Routing Solution

Zalando Engineering

Skipper is the open-source HTTP router we’ve created to help us rebuild the infrastructure behind Zalando’s customer-facing Fashion Store (“the Shop”). Developed with Go, it’s “go get” compatible and serves as a common entry point in front of the Shop’s service components. Skipper can be useful for non-Zalando teams who are trying to deploy a microservices architecture and want (or need) to decouple routing from service logic.

article thumbnail

Top Hadoop Projects and Spark Projects for Beginners 2021

ProjectPro

Big data has taken over many aspects of our lives and as it continues to grow and expand, big data is creating the need for better and faster data storage and analysis. Apache Hadoop and Apache Spark fulfill this need as is quite evident from the various projects that these two frameworks are getting better at faster data storage and analysis. These Apache Hadoop projects are mostly into migration, integration, scalability, data analytics, and streaming analysis.

Hadoop 52
article thumbnail

Impala vs Hive: Difference between Sql on Hadoop components

ProjectPro

Hadoop has continued to grow and develop ever since it was introduced in the market 10 years ago. Every new release and abstraction on Hadoop is used to improve one or the other drawback in data processing, storage and analysis. Apache Hive was introduced by Facebook to manage and process the large datasets in the distributed storage in Hadoop. Apache Hive is an abstraction on Hadoop MapReduce and has its own SQL like language HiveQL.

Hadoop 52
article thumbnail

How to Web Summit

Zalando Engineering

“In 4 years, Web Summit has grown from 400 attendees to over 22,000 from more than 110 countries. It’s been called ‘the best technology conference on the planet.’ But we just think it‘s different. And that difference works for our attendees, ranging from Fortune 500 companies to the world’s most exciting startups.” — websummit.com Zalando is participating in this year's Web Summit in Dublin, Ireland with a booth, a fireside chat on the mainstage featuring our cofounder Robert Gentz, a panel on t

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Read About Zalando UX in Smashing Magazine

Zalando Engineering

"Modern motivational psychology says that employees in the knowledge economy are motivated not by carrots and sticks but by purpose, not by tasks but by mastery. Similarly, Simon Sinek, author of the bestseller Start With Why , argues that the problem with typical job ads is that they skip over the purpose: 'They are all about the what, and not the why.

article thumbnail

Video: Swagger Creator Mentions Zalando Open Source

Zalando Engineering

As part of Zalando Tech's API First approach to software development, many of our teams are building open-source tools for working with Swagger. One of these projects is Connexion : A Python Flask framework for automatically handling REST API requests based on Swagger 2.0 specification files in YAML.

Python 40

More Trending

article thumbnail

How I Created My Own Ecommerce App Without Leaving Zalando

Zalando Engineering

KOKOWINKA * is a Mobile First web app I’ve created that sells fashion items at a discount (starting at 30 percent) to Spanish consumers. It works like this: A customer purchases an item featured by an online retailer like Zalando, then the retailer pays me a reward (up to 15 percent of the selling price). As the affiliate marketer, I don’t have to worry about purchase payments, refunds or shipping.

Retail 40
article thumbnail

How Zalando's Using Clojure+Spark (Slides)

Zalando Engineering

Senior Software/Data Engineer Hunter Kelly of Zalando’s Dublin Fashion Insights Centre presented at this week’s Clojure/Conj on how we’re using Clojure and MLib to understand fashion in a more quantitative manner. Hunter’s talk — "Using Clojure+Spark to Find All the Topics on the Interwebs"— centered on our efforts to harness data from crowd-sourced websites such as DMOZ and Common Crawl , which enables us to explore methods of categorising the web into a set of known fashion-related topics.

article thumbnail

Why "Open Source First"

Zalando Engineering

In a recent meeting of Zalando Tech’s Open Source Guild — our informal, bimonthly gathering of FOSS advocates and evangelists — we discussed our now-published open source principles and the importance of Principle #1: “Do ‘Open Source First.’” In other words, if your Zalando project can also be useful to the tech world at-large, “release it as open source from the start.

article thumbnail

Achieving Correct Bloat Estimates of JSON Data in PostgreSQL

Zalando Engineering

Recently my team realized that tables in one of our PostgreSQL databases were showing colossal amounts of bloat: up to 40 out of 54 GB total (75%) for bigger tables, and up to 95% of 17 GB total for smaller ones. Having accurate estimates is important to make certain database administration decisions aimed at reclaiming disk space and improving database performance, but these numbers were something very unusual, so we wanted to investigate first.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Doing Data Science for Social Good

Zalando Engineering

We recently teamed up with the Data Science for Social Good Berlin ( DSSG ) chapter to host their first-ever DataDive in our Shuttle Innovation Lab. More than 60 data scientists, data enthusiasts and other technologists from the Berlin tech community spent Friday night through Sunday afternoon working with datasets provided by the nonprofit organizations streetfootballworld , Jambo Bukoba and DataLook.

article thumbnail

Zalando Tech's New Open Source Principles

Zalando Engineering

Two important parts of Zalando Technology's culture — our self-organized guilds, and our support for open source— intersect via our Open Source Guild. The Guild is an informal group of engineers and tech evangelists dedicated to strengthening our open source culture both internally and externally. Every two weeks, Guild members meet to brainstorm ideas for promoting our projects to the tech community; collaborate on internal policies related to licensing and other relevant topics, and trade insi

Media 40
article thumbnail

Video: "A Tale of Automation and Legacy"

Zalando Engineering

Last month my colleague Igor Ramadas and I attended ForgeRock’s Identity Summit in London, where we presented a talk on Zalando’s efforts to enable business continuity while migrating to the cloud. With automation in mind, we showed how using (some) coding tweaks makes it possible for two different worlds to communicate securely: Our new cloud apps, based on STUPS and Amazon Web Services; and our legacy apps, which reside in our datacenters.

article thumbnail

Watch: "How to Auto-Scale Your API" (Video)

Zalando Engineering

Given Zalando’s rapid growth, adopting an API First approach has proven to be one of the most effective ways to manage big data and facilitate an effective and easier customer experience for a larger audience. Last month Zalando Delivery Lead Sean Floyd and Software Engineer Luis Mineiro traveled to Belgrade, Serbia to speak at the Voxxed Days Belgrade conference about API First — focusing specifically on “ How to Auto-Scale Your API.

Java 40
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Zalando Tech Screens "Big Dream" on Nov. 10

Zalando Engineering

As part of Zalando’s efforts to promote diversity in tech, we’ll screen the documentary Big Dream on November 10 at our Berlin technology HQ. This documentary film, directed by Kelly Cox and Iron Way Films and co-produced by Microsoft, follows the stories of seven women who overcome obstacles in following their STEM (Science, Technology, Engineering and Math)-related career paths.