Data Engineering Podcast

MARCH 25, 2018

Summary The data that is used in financial markets is time oriented and multidimensional, which makes it difficult to manage in either relational or timeseries databases. To make this information more manageable the team at Alapaca built a new data store specifically for retrieving and analyzing data generated by trading markets. In this episode Hitoshi Harada, the CTO of Alapaca, and Christopher Ryan, their lead software engineer, explain their motivation for building MarketStore, how it operat

Management 100

Management Software Engineer Software Engineering Algorithm 100

Uber Engineering

MARCH 22, 2018

Much of Uber’s business involves connecting people with people, making the reliability of our customer platform crucial to our success. The customer platform supports everything from ridesharing and Uber Eats , to Uber Freight and Uber for Business. Our … The post Introducing QALM, Uber’s QoS Load Management Framework appeared first on Uber Engineering Blog.

Management 81

Management Engineering Architecture 81

Zalando Engineering

MARCH 19, 2018

Introducing Semantic Web Technologies at Zalando Two years ago, in March 2016, the newly-opened Helsinki office wondered about the expressivity of our current product data. What do attributes like material construction or sport quality really mean, and how can we use them to create meaningful fashion experiences online for our customers? It was around that time that, after working for five years solely in the art sector and building digital strategies for various classical music organisations, I

Scala 52

Scala Machine Learning Deep Learning Algorithm 52

ProjectPro

MARCH 1, 2018

News on Hadoop - February 2018 Kyvos Insights to Host Webinar on Accelerating Business Intelligence with Native Hadoop BI Platforms. PRNewswire.com, February 1, 2018. The leading big data analytics company Kyvo Insights is hosting a webinar titled “Accelerate Business Intelligence with Native Hadoop BI platforms.” on February 7, 2018 at 10 AM PST.

Hadoop 52

Hadoop NoSQL Retail BI 52

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Cloudera

MARCH 2, 2018

If you do an internet search for ‘data-driven disruption’ you can find articles about almost every industry being disrupted by digitalisation and new applications of data. Banking, transportation, healthcare, retail, and real estate, all have seen the emergence of new business models fundamentally changing how customers use their services. While there are instances of data-driven efforts in the nonprofit sector, they are not as widespread as they can be.

Hospitality 44

Hospitality Healthcare Machine Learning Transportation 44

nodeSWAT

MARCH 27, 2018

Most of the webpages I’ve built run around the idea that people come, do their things and then go away. This process is repeated for every time they need the functionalities provided by the site, be it an investment platform, e-shop or some sort of an administration tool. But what if the users don’t leave, ever? What if they keep the page open 24/7, without refreshing, re-logging or re-entering the site.

Building 40

Building Coding Project Process 40

Uber Engineering

MARCH 13, 2018

To build and maintain infrastructure at scale, easy access to the current state of the system is paramount. As Uber’s business continues to expand, our infrastructure has grown in size and complexity, making it more difficult to get all the … The post Scaling Infrastructure Management with Grail appeared first on Uber Engineering Blog.

Management 75

Management Engineering Accessibility Accessible 75

Zalando Engineering

MARCH 28, 2018

Last week, at our new-format Zalando Hack Week , two important departments dropped their day-to-day tasks and embarked on what, for many of them, was their first ever hackathon. How did this come about? Zalando’s new Hack Week is a departure from the hackathons we have organised in the past, which typically only involved the tech department and happened once a year.

Programming 40

Programming Designing Project Technology 40

Data Engineering Podcast

MARCH 11, 2018

Summary As software lifecycles move faster, the database needs to be able to keep up. Practices such as version controlled migration scripts and iterative schema evolution provide the necessary mechanisms to ensure that your data layer is as agile as your application. Pramod Sadalage saw the need for these capabilities during the early days of the introduction of modern development practices and co-authored a book to codify a large number of patterns to aid practitioners, and in this episode he

Database 100

Database MongoDB NoSQL Database Design 100

Data Engineering Podcast

MARCH 4, 2018

Summary Data is an increasingly sought after raw material for business in the modern economy. One of the factors driving this trend is the increase in applications for machine learning and AI which require large quantities of information to work from. As the demand for data becomes more widespread the market for providing it will begin transform the ways that information is collected and shared among and between organizations.

Raw Data 100

Raw Data Machine Learning Data Pipeline Data 100

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Cloudera

MARCH 6, 2018

The real power in machine learning and analytics is when multiple analytics disciplines are able to work together in concert, sharing data in service of solving more complex and more valuable questions. That’s what Cloudera SDX (Shared Data Experience) enables for our customers and why we’re so excited to introduce it today for Cloudera Altus.

Cloud 40

Cloud Metadata Big Data Analytics Application 40

Zalando Engineering

MARCH 26, 2018

How former Zalando trainee, Anriika Kauppi, found her calling Fresh out of high school, Anriika Kauppi, 19, was interested in becoming a teacher, but instead of taking the scholastic route, she did a summer traineeship at Zalando’s Helsinki Tech Hub. With a family background in tech, Anriika wanted to see what the field had to offer as a career. A year and a half later, she has lived abroad for three months, completed another internship in the tech field, and applied to study engineering.

Banking 40

Banking Programming Technology Python 40

Uber Engineering

MARCH 22, 2018

Much of Uber’s business involves connecting people with people, making the reliability of our customer platform crucial to our success. The customer platform supports everything from ridesharing and Uber Eats , to Uber Freight and Uber for Business. Our … The post Introducing QALM, Uber’s QoS Load Management Framework appeared first on Uber Engineering Blog.

Management 40

Management Engineering Architecture 40

Zalando Engineering

MARCH 21, 2018

Insights on making NodeJS APIs great NodeJS is getting more and more popular these days. It’s gone through a long and painful history of mistakes and learning. By being a “window” for front-end developers to the “world of back-end,” it has improved the overall tech knowledge of each group of engineers by giving them the opportunity to write actual end-to-end solutions themselves using familiar approaches.

MongoDB 40

MongoDB Coding Electronics Database 40

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

Zalando Engineering

MARCH 14, 2018

Removing the burden of state management State management and change propagation are arguably some of the hardest challenges in GUI programming. Many tools promised to save us from their burden. Only a few remained. Among them is MobX and its flavor of Transparent Reactive Programming. To understand the appeal of MobX, it is helpful to first understand how React revolutionized GUI programming.

Programming 40

Programming Coding Management Building 40

Zalando Engineering

MARCH 12, 2018

Engineering Lead, Michael Duergner on the company’s newest tech hub Now in its 10th year of operation, Zalando continues to focus on a smooth and inspiring digital experience for its customers with the opening of its latest tech hub in Lisbon , among other initiatives. We talk to engineering lead, Michael Duergner, who tells us more about the newest Zalando location and the company’s personalization plans.

Certification 40

Certification Engineering Database Programming 40

Zalando Engineering

MARCH 7, 2018

Red flags to look out for in badly written projects. Let’s talk about common red flags or alternatively, how to define badly-written project. Many of us have experienced a project which is crying and begging for something drastic to change, or even for it to be put out of its misery altogether, but alas; we don’t have the heart or the resources to “pull the plug” as it were.

Project 40

Project Coding Technology IT 40

Zalando Engineering

MARCH 5, 2018

Scaling operational excellence Zalando is iterating our production incident handling process. The previous process had a dedicated Tier One 24/7 team who coordinated the incident response communication while escalating to the service-owning Tier Two team(s) for a resolution. That has been rationalized to those service-owning teams handling their incident flow, from alert to post-mortem to reduce time to resolution.

AWS 40

AWS Systems Process Building 40

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence