November, 2015

article thumbnail

Building Our Own Open-Source HTTP Routing Solution

Zalando Engineering

Skipper is the open-source HTTP router we’ve created to help us rebuild the infrastructure behind Zalando’s customer-facing Fashion Store (“the Shop”). Developed with Go, it’s “go get” compatible and serves as a common entry point in front of the Shop’s service components. Skipper can be useful for non-Zalando teams who are trying to deploy a microservices architecture and want (or need) to decouple routing from service logic.

article thumbnail

Top Hadoop Projects and Spark Projects for Beginners 2021

ProjectPro

Big data has taken over many aspects of our lives and as it continues to grow and expand, big data is creating the need for better and faster data storage and analysis. Apache Hadoop and Apache Spark fulfill this need as is quite evident from the various projects that these two frameworks are getting better at faster data storage and analysis. These Apache Hadoop projects are mostly into migration, integration, scalability, data analytics, and streaming analysis.

Hadoop 52
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Impala vs Hive: Difference between Sql on Hadoop components

ProjectPro

Hadoop has continued to grow and develop ever since it was introduced in the market 10 years ago. Every new release and abstraction on Hadoop is used to improve one or the other drawback in data processing, storage and analysis. Apache Hive was introduced by Facebook to manage and process the large datasets in the distributed storage in Hadoop. Apache Hive is an abstraction on Hadoop MapReduce and has its own SQL like language HiveQL.

Hadoop 52
article thumbnail

How to Web Summit

Zalando Engineering

“In 4 years, Web Summit has grown from 400 attendees to over 22,000 from more than 110 countries. It’s been called ‘the best technology conference on the planet.’ But we just think it‘s different. And that difference works for our attendees, ranging from Fortune 500 companies to the world’s most exciting startups.” — websummit.com Zalando is participating in this year's Web Summit in Dublin, Ireland with a booth, a fireside chat on the mainstage featuring our cofounder Robert Gentz, a panel on t

article thumbnail

Precision in Motion: Why Process Optimization Is the Future of Manufacturing

Speaker: Jason Chester, Director, Product Management

In today’s manufacturing landscape, staying competitive means moving beyond reactive quality checks and toward real-time, data-driven process control. But what does true manufacturing process optimization look like—and why is it more urgent now than ever? Join Jason Chester in this new, thought-provoking session on how modern manufacturers are rethinking quality operations from the ground up.

article thumbnail

Read About Zalando UX in Smashing Magazine

Zalando Engineering

"Modern motivational psychology says that employees in the knowledge economy are motivated not by carrots and sticks but by purpose, not by tasks but by mastery. Similarly, Simon Sinek, author of the bestseller Start With Why , argues that the problem with typical job ads is that they skip over the purpose: 'They are all about the what, and not the why.

article thumbnail

How to Prepare for Your Zalando Tech Interview

Zalando Engineering

Think you've got what it takes to work for Zalando's technology team? Here's some advice from Zalando VP Engineering Eric Bowman on what we're looking for. At Zalando, we are looking for people who: Make it happen Grow stronger every day Always team up and empower others Change the game Our tech interviewing process is designed to reveal the skills that candidates have (and whether you have represented them honestly and accurately); to understand whether a candidate is someone who will thrive at

Systems 40

More Trending

article thumbnail

How I Created My Own Ecommerce App Without Leaving Zalando

Zalando Engineering

KOKOWINKA * is a Mobile First web app I’ve created that sells fashion items at a discount (starting at 30 percent) to Spanish consumers. It works like this: A customer purchases an item featured by an online retailer like Zalando, then the retailer pays me a reward (up to 15 percent of the selling price). As the affiliate marketer, I don’t have to worry about purchase payments, refunds or shipping.

Retail 40
article thumbnail

How Zalando's Using Clojure+Spark (Slides)

Zalando Engineering

Senior Software/Data Engineer Hunter Kelly of Zalando’s Dublin Fashion Insights Centre presented at this week’s Clojure/Conj on how we’re using Clojure and MLib to understand fashion in a more quantitative manner. Hunter’s talk — "Using Clojure+Spark to Find All the Topics on the Interwebs"— centered on our efforts to harness data from crowd-sourced websites such as DMOZ and Common Crawl , which enables us to explore methods of categorising the web into a set of known fashion-related topics.

article thumbnail

Why "Open Source First"

Zalando Engineering

In a recent meeting of Zalando Tech’s Open Source Guild — our informal, bimonthly gathering of FOSS advocates and evangelists — we discussed our now-published open source principles and the importance of Principle #1: “Do ‘Open Source First.’” In other words, if your Zalando project can also be useful to the tech world at-large, “release it as open source from the start.

article thumbnail

Achieving Correct Bloat Estimates of JSON Data in PostgreSQL

Zalando Engineering

Recently my team realized that tables in one of our PostgreSQL databases were showing colossal amounts of bloat: up to 40 out of 54 GB total (75%) for bigger tables, and up to 95% of 17 GB total for smaller ones. Having accurate estimates is important to make certain database administration decisions aimed at reclaiming disk space and improving database performance, but these numbers were something very unusual, so we wanted to investigate first.

article thumbnail

Airflow Best Practices for ETL/ELT Pipelines

Speaker: Kenten Danas, Senior Manager, Developer Relations

ETL and ELT are some of the most common data engineering use cases, but can come with challenges like scaling, connectivity to other systems, and dynamically adapting to changing data sources. Airflow is specifically designed for moving and transforming data in ETL/ELT pipelines, and new features in Airflow 3.0 like assets, backfills, and event-driven scheduling make orchestrating ETL/ELT pipelines easier than ever!

article thumbnail

Zalando Tech's New Open Source Principles

Zalando Engineering

Two important parts of Zalando Technology's culture — our self-organized guilds, and our support for open source— intersect via our Open Source Guild. The Guild is an informal group of engineers and tech evangelists dedicated to strengthening our open source culture both internally and externally. Every two weeks, Guild members meet to brainstorm ideas for promoting our projects to the tech community; collaborate on internal policies related to licensing and other relevant topics, and trade insi

Media 40
article thumbnail

Doing Data Science for Social Good

Zalando Engineering

We recently teamed up with the Data Science for Social Good Berlin ( DSSG ) chapter to host their first-ever DataDive in our Shuttle Innovation Lab. More than 60 data scientists, data enthusiasts and other technologists from the Berlin tech community spent Friday night through Sunday afternoon working with datasets provided by the nonprofit organizations streetfootballworld , Jambo Bukoba and DataLook.

article thumbnail

Video: "A Tale of Automation and Legacy"

Zalando Engineering

Last month my colleague Igor Ramadas and I attended ForgeRock’s Identity Summit in London, where we presented a talk on Zalando’s efforts to enable business continuity while migrating to the cloud. With automation in mind, we showed how using (some) coding tweaks makes it possible for two different worlds to communicate securely: Our new cloud apps, based on STUPS and Amazon Web Services; and our legacy apps, which reside in our datacenters.

article thumbnail

Zalando Tech Screens "Big Dream" on Nov. 10

Zalando Engineering

As part of Zalando’s efforts to promote diversity in tech, we’ll screen the documentary Big Dream on November 10 at our Berlin technology HQ. This documentary film, directed by Kelly Cox and Iron Way Films and co-produced by Microsoft, follows the stories of seven women who overcome obstacles in following their STEM (Science, Technology, Engineering and Math)-related career paths.

article thumbnail

Whats New in Apache Airflow 3.0 –– And How Will It Reshape Your Data Workflows?

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

article thumbnail

Watch: "How to Auto-Scale Your API" (Video)

Zalando Engineering

Given Zalando’s rapid growth, adopting an API First approach has proven to be one of the most effective ways to manage big data and facilitate an effective and easier customer experience for a larger audience. Last month Zalando Delivery Lead Sean Floyd and Software Engineer Luis Mineiro traveled to Belgrade, Serbia to speak at the Voxxed Days Belgrade conference about API First — focusing specifically on “ How to Auto-Scale Your API.

Java 40