Uber Engineering

MAY 14, 2019

Uber operates on a global scale across more than 600 cities, with our apps relying entirely on wireless connectivity from over 4,500 mobile carriers. To deliver the real-time performance expected from Uber’s users, our mobile apps require low-latency and highly … The post Employing QUIC Protocol to Optimize Uber’s App Performance appeared first on Uber Engineering Blog.

Engineering 112

Engineering Architecture 112

Teradata

MAY 14, 2019

Cheryl Wiebe explains why AI for industrial use cases is a more complicated road than it appears.

IT 103

IT 103

Confluent

MAY 13, 2019

In the last year, we’ve experienced enormous growth on Confluent Cloud, our fully managed Apache Kafka ® service. Confluent Cloud now handles several GB/s of traffic—a 200-fold increase in just six months. As Confluent Cloud has grown, we’ve noticed two gaps that very clearly remain to be filled in managed Apache Kafka services. First, all the Kafka services out there still require you to size and provision a cluster, which inevitably leads to a poor developer experience, over-provisioned capaci

Kafka 98

Kafka Cloud Management Building 98

Rockset

MAY 17, 2019

The best way to answer questions about user behavior is often to gather data. A common pattern is to track user clicks throughout a product, then perform analytical queries on the resulting data, getting a holistic understanding of user behavior. In my case, I was curious to get a pulse of developer preferences on several divisive questions. So, I built a simple survey and gathered tens of thousands of data points from developers on the Internet.

Building 52

Building SQL NoSQL Data 52

Advertisement

In Airflow, DAGs (your data pipelines) support nearly every use case. As these workflows grow in complexity and scale, efficiently identifying and resolving issues becomes a critical skill for every data engineer. This is a comprehensive guide with best practices and examples to debugging Airflow DAGs. You’ll learn how to: Create a standardized process for debugging to quickly diagnose errors in your DAGs Identify common issues with DAGs, tasks, and connections Distinguish between Airflow-relate

Data Pipeline

Zalando Engineering

MAY 15, 2019

A closer look at how the Linux kernel influences Redis memory management Recently, I was talking to a long-time friend, previous university colleague and former boss, who mentioned the fact that Redis was failing to persist data to disk in low memory conditions. For that reason, he advised to never let a Redis in-memory dataset to be bigger than 50% of the system memory.

Datasets 51

Datasets Systems Python Coding 51

Teradata

MAY 13, 2019

Carrie Ballinger reveals the frequently under-appreciated component within Teradata Vantage, the BYNET.

IT 81

IT 81

Cloudera

MAY 15, 2019

With Dataworks Summit kicking off in Washington, DC next week, we are super excited to have Charles Boicey MS, RN-BC and Chief Innovation Officer for Clearsense, as one of the keynote speakers. A notable expert and clinical information systems specialist, Charles, offers his 25-plus years of strategic leadership. He is a successful architect of healthcare data warehouses, clinical and business intelligence tools, big data ecosystems, and a health information exchange.

Cloud 50

Cloud Hadoop Healthcare Big Data Ecosystem 50

Rockset

MAY 17, 2019

We love a good debate. And we love data. So when the existential question of spaces vs. tabs came up in our team, we just had to run a real-time survey and collect thousands of data points around it. While we were at it, we figured it was time to settle the debate around other equally important developer issues like Hint vs. LaCroix, Vim vs. Emacs, and more.

NoSQL 52

NoSQL SQL Kafka Data Pipeline 52

Confluent

MAY 14, 2019

A technology community is made up of people. Without people writing code, writing tutorials, welcoming newcomers, giving presentations, and answering questions, what we have is not a community, but just a set of Git repositories. We’re grateful that the Apache Kafka ® and Confluent communities are composed of hundreds of thousands of people all over the world who are constantly doing all of these things.

Programming 84

Programming Kafka Education Coding 84

Cloudera

MAY 16, 2019

Coming up, Cloudera will be featured at Informatica World (global customer event) in Las Vegas. The conference provides a useful opportunity to reflect on the rapid evolution we’ve seen in the Data Integration and Management space, much of it driven by the innovations that Cloudera and the open source community have been delivering. First off, it’s important to recognize the impressive job that Informatica has done in re-inventing itself and adapting to this new technology ecosystem.

Data Warehouse 40

Data Warehouse Government Data Preparation Data Governance 40

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data