Uber Engineering
MAY 17, 2016
Our last article on Uber for Business (U4B) discussed implementing our ride profiles feature. Today, we want to share more insight into the kind of technical challenges we’re solving. Just because our mission is to improve businesses’ experiences doesn’t … The post How Uber for Business Engineering Verifies Your Ride in Real Time appeared first on Uber Engineering Blog.
Zalando Engineering
MAY 12, 2016
One of the favourite parts of my job is that I get to discuss and share insights with relevant professionals of how to best apply user-centered design practice in organisations. When we talk about user-centered design, we often say it is about placing users at the centre of a product. What does that really mean? How do you understand it and apply in your daily product design process?
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
ProjectPro
MAY 2, 2016
News on Hadoop-April 2016 Cutting says Hadoop is not at its peak but at its starting stages. April 1, 2016. Datanami.com At his keynote address in San Jose, Strata+Hadoop World 2016, Doug Cutting said that Hadoop is not at its peak and not going to phase out. Hadoop is still undergoing digital mutations and the experts are considering it to be in its starting stages.
Zalando Engineering
MAY 10, 2016
At Zalando, we strive to help our customers find the most relevant fashion they can imagine. Zalando is known for its great fashion assortment and its huge selection of products. In order to ensure that our customers are not overwhelmed by this vast selection of products, the Recommendations Team builds systems that ensure that customers find products in an easy and convenient way.
Advertisement
In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate
Zalando Engineering
MAY 31, 2016
Many teams at Zalando have been using Docker-Selenium : A project that aims to provide Selenium inside a Docker container with Chrome and Firefox. Leo Gallucci, Docker-Selenium’s creator and an engineer on our Test Infrastructure team, sat down with Zalando Open Source Evangelist Lauri Apple to take a closer look at his two-year-old project. Lauri Apple: Why did you create Docker-Selenium?
ProjectPro
MAY 30, 2016
The next in the series of articles highlighting the most commonly asked Hadoop Interview Questions, related to each of the tools in the Hadoop ecosystem is - Hadoop HDFS Interview Questions and Answers. Table of Contents Commonly Asked HDFS Interview Questions and Answers for 2023 HDFS Interview Questions and Answers to prepare for Hadoop Job Interview in 2023 Ace Your Next Job Interview with Mock Interviews from Experts to Improve Your Skills and Boost Confidence!
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
|
Zalando Engineering
MAY 25, 2016
On May 10th, Zalando was among the four technology unicorns that presented at Microservices Day London, along with RedHat, Uber, and AutoScout 24. Microservices Day is a one-day, single-track, non-profit event that focuses on the business benefits of utilising microservices. Since we’ve begun moving our Fashion Store from a monolith to microservices , we wanted to share what Zalando has learned from the past year of digging deeper into data integration in a microservices-based environment.
Zalando Engineering
MAY 24, 2016
Zalando Tech is hosting a 24-hour online hackathon on June 4, known as the Zalando CodeSprint , in partnership with HackerRank. We’ve put together eight system-graded challenges to solve, with participants welcome from anywhere in the world. In the lead up to this exciting challenge, we wanted to catch up with a couple of the developers who helped craft each problem statement, and find out the motivations behind the event.
Zalando Engineering
MAY 23, 2016
The Zalando Techspert Series: A Zalando-led initiative to encourage and initiate discussions about ‘softer’ tech topics such as, but not limited to, agility, tech culture, and Berlin as Europe’s most magnetic tech hub. Why have we set this up? We want to spearhead the discussions that matter to tech companies and businesses of all sizes: How to recruit top talent, how to inspire innovation, and how to be leaders in a competitive digital market.
Zalando Engineering
MAY 23, 2016
It’s no secret that Zalando Tech has had its hands full lately with its participation in several Scala conferences and meetups. As a company who practices Radical Agility , our use of Scala has skyrocketed and it’s now one of our most adopted programming languages amongst developers. So, where have we been in the Scala world? Where are we headed to next?
Speaker: Tamara Fingerlin, Developer Advocate
Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.
ProjectPro
MAY 20, 2016
With petabytes of digital information surrounding us on any topic under the sun, we often forget the importance of reading a book , to gain in-depth understanding about the latest big data technologies. We usually refer to the information available on sites like ProjectPro, where the free resources are quite informative, when it comes to learning about Hadoop and its components.
Zalando Engineering
MAY 19, 2016
I recently started using Rust – the programming language. My team had thought about the idea of using a polyglot approach when building services – we think that we should always use the right tool for the job. We also believe that we should build our services so that others can use them, thus, while prototyping, we’ve built projects in many programming languages as part of migrating our shop monolith to microservices.
ProjectPro
MAY 18, 2016
Big data industry has made Hadoop as the cornerstone technology for large scale data processing but deploying and maintaining Hadoop clusters is not a cakewalk. The challenges in maintaining a well-run Hadoop environment has led to the growth of Hadoop-as-a-Service (HDaaS) market. “Typical enterprise Hadoop distributions rely on a lot of moving parts -- leveraging up to 20 or more disparate components -- which leads to management complexity and total cost of ownership (TCO) issues.”-
Zalando Engineering
MAY 18, 2016
After our incredibly successful Stack Overflow event , we were impressed with how open and approachable Joel Spolsky was to our team of developers and recruiters. Not only did he take part in a great Q&A session with our VP of Engineering Eric Bowman, but he also hung around afterwards to spend some quality time with Zalando’s tech recruiters, sharing his knowledge as a founder and CEO.
Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage
There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.
Zalando Engineering
MAY 17, 2016
Since last year, Zalando has sped up its adoption of cloud-provided, on-demand infrastructure; we decided to embrace AWS. This meant teams would be given more freedom by being allowed to administer their own AWS accounts. In addition to this, we were presented with a useful set of tools called STUPS. Explaining STUPS in detail would require a whole blog post in itself!
Zalando Engineering
MAY 16, 2016
Half year ago, we agreed on a set of principles and started working on our Tech Radar; now, we’re proud of having published its second release for Zalando Technology. We’ve also open sourced the Zalando Tech Radar visualisation (including code) via our public GitHub repository. Some of the more prominent changes compared with first Radar release are: Play for Scala and Sbt moved from Trial to Adopt Kafka also moved from Trial to Adopt Flink changed from Assess to Trial AngularJS 2.x rises to Ass
ProjectPro
MAY 12, 2016
Big Data has found a comfortable home inside the Hadoop ecosystem. Hadoop based data stores have gained wide acceptance around the world by developers, programmers, data scientists, and database experts. Convenient as the data storage is, Hadoop’s inherent reporting mechanism presents a number of challenges to be overcome, the prominent ones being learning a new language from scratch (for querying and reporting on Hadoop data sets) and performance related issues.
Zalando Engineering
MAY 9, 2016
Zalando Tech has gone through some enormous changes in the last year, with the transition of its online Fashion Store from a monolithic application, hosted in datacenters, to microservices, hosted on AWS. To deal with this change, the Zalando STUPS platform was created, allowing our autonomous teams to easily deploy their services via Docker containers.
Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives
Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri
Zalando Engineering
MAY 8, 2016
As part of my daily UX job, I get to research a lot of mobile apps. Lately, I have been looking into different ways to move back one screen without having to tap on the “back” button. Simply put, see this interaction situation: On iOS and Android, “back” interaction is generally placed in the top left area in the title bar (except for some cases on Android, which has a physical “back” button on the device).
Zalando Engineering
MAY 5, 2016
With this year being the 10th birthday of Apache Hadoop, Dublin saw 1,400 members of the tech community gather for the 4th Hadoop Summit Europe. These days, the word Hadoop has a somewhat negative connotation in the minds of some people, but this Summit proved that it is an all-encompassing word to describe a diverse ecosystem of technologies. With our Fashion Insights Centre located in Dublin, where our engineers and data scientists use several Hadoop technologies, it made perfect sense for Zal
Zalando Engineering
MAY 2, 2016
Spray is a well-known HTTP library in the Scala ecosystem. It was released in 2011, and since then it’s been widely used by the Scala community. It was recently announced that Spray would be replaced with Akka HTTP, thus cementing Akka HTTP as the successor of Spray. It’s maintained by Lightbend and it's been recommended that users migrate to it soon.
ProjectPro
MAY 13, 2016
Hadoop is the most talked about innovation in the IT industry that has shaken the entire data centre infrastructure at many organizations. As the appetite for Hadoop and related big data technologies grows at an exponential rate, it is not out to spell the death of data warehousing. Data warehousing as a technology is evolving. Hadoop replacing the data warehouses still continues to be the hot-topic of discussion, even as mass majority of the enterprises continue to claim that they still need da
Advertisement
Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.
Expert insights. Personalized for you.
111 
Let's personalize your content