Confluent

OCTOBER 23, 2020

Apache Kafka® is a distributed real-time processing platform that allows for the ingestion of huge volumes of data. ksqlDB is part of the Kafka ecosystem and offers a SQL-like language […].

Kafka 142

Kafka SQL Process Data 142

Cloudera

OCTOBER 20, 2020

Introduction. Today we are introducing a new series of blog posts that will take a look at recent enhancements to Apache Impala. Many of these are performance improvements, such as the feature described below which will give anywhere from a 2x to 7x performance improvement by taking better advantage of all the CPU cores. In addition, a lot of work has also been put into ensuring that Impala runs optimally in decoupled compute scenarios, where the data lives in object storage or remote HDFS.

Utilities 103

Utilities Data Warehouse Cloud SQL 103

Data Engineering Podcast

OCTOBER 19, 2020

Summary In order for analytics and machine learning projects to be useful, they require a high degree of data quality. To ensure that your pipelines are healthy you need a way to make them observable. In this episode Barr Moses and Lior Gavish, co-founders of Monte Carlo, share the leading causes of what they refer to as data downtime and how it manifests.

Machine Learning 100

Machine Learning Data Engineering Data Engineer Data 100

Netflix Tech

OCTOBER 19, 2020

by Maulik Pandey Our Team?—? Kevin Lew , Narayanan Arunachalam , Elizabeth Carretto , Dustin Haffner , Andrei Ushakov, Seth Katz , Greg Burrell , Ram Vaithilingam , Mike Smith and Maulik Pandey “ @Netflixhelps Why doesn’t Tiger King play on my phone?”?—?a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?

Building 95

Building Transportation Java Metadata 95

Speaker: Tamara Fingerlin, Developer Advocate

Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.

Data

Confluent

OCTOBER 21, 2020

Every organization that exposes its services online is subject to the interest of malicious actors. The ongoing struggle with botnets, crawlers, script kiddies, and bounty hunters is challenging and requires […].

Management 116

Management IT Retail Kafka 116

Cloudera

OCTOBER 20, 2020

There are some people who will tell you, “you can do anything you want to do in life”, and then there are some people who can show you that’s true. Otho Lyon – Director of Support, Public Sector – is one of those people. . For over four years, Otho has been Cloudera’s Director of Support – Public Sector. He leads the charge in the support strategy and execution of our most sensitive and secure government agency clients.

Recruitment 101

Recruitment Big Data Machine Learning Government 101

Teradata

OCTOBER 21, 2020

Two major forces impacting IT are on a collision course: the desire for a “modern data architecture” and businesses' need for data analytics. Find out more.

Architecture 52

Architecture Data Architecture Data Analytics IT 52

Confluent

OCTOBER 22, 2020

It’s important to be able to limit memory consumption of a running service. Use too much, and your application will crash and need to restart. If this happens too often, […].

Process 108

Process 108

Cloudera

OCTOBER 22, 2020

Cloudera recently appointed its first-ever Chief Diversity Officer, Sarah Shin. To maintain transparency about our diversity and inclusion (D&I) progress, we’ve asked her to share her vision for Cloudera’s future, and the initial steps she’s taking to help us get there. Q1: What drew you to work in the D&I space? . As a biracial woman, diversity and inclusion was a large part of my life before I even knew what it meant.

Building 69

Building Programming Finance Education 69

Cloudera

OCTOBER 22, 2020

Replication ( covered in this previous blog article ) has been released for a while and is among the most used features of Apache HBase. Having clusters replicating data with different peers is a very common deployment, whether as a DR strategy or simply as a seamless way of replicating data between production/staging/development environments. Although it is an efficient way of keeping different HBase databases in sync within a sub-second latency, replication only operates over data ingested aft

Bytes 64

Bytes Datasets Data Data Ingestion 64

Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage

There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.

Systems

Teradata

OCTOBER 21, 2020

There is a lot of debate about what Modern Architecture means & what it actually comprises. However, the two terms that come up the most often are: simplicity & flexibility.

Architecture 52

Architecture IT 52

Teradata

OCTOBER 20, 2020

In part 2 of this series, we will cover techniques for defining & gathering availability requirements and making sure your business continuity solution provides the most potential ROI.

52

52

Teradata

OCTOBER 19, 2020

Marketing is essential. It drives revenue and is a big investment for banks. But marketers cannot grow the size of the pie – only their slice of it. Read more.

Banking 52

Banking IT 52

Cloudera

OCTOBER 21, 2020

The Insurance industry is in uncharted waters and COVID-19 has taken us where no algorithm has gone before. Today’s models, norms, and averages are being re-written on the fly, with insurers forced to cope with the inevitable conflict between old standards and the new normal. . Take the restaurants of New York City suing their insurers for hundreds of millions of dollars.

Insurance 72

Insurance Unstructured Data Hospitality Media 72

Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives

Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri

Manufacturing