Confluent

OCTOBER 23, 2020

Apache Kafka® is a distributed real-time processing platform that allows for the ingestion of huge volumes of data. ksqlDB is part of the Kafka ecosystem and offers a SQL-like language […].

Kafka 143

Kafka SQL Process Data 143

Cloudera

OCTOBER 20, 2020

There are some people who will tell you, “you can do anything you want to do in life”, and then there are some people who can show you that’s true. Otho Lyon – Director of Support, Public Sector – is one of those people. . For over four years, Otho has been Cloudera’s Director of Support – Public Sector. He leads the charge in the support strategy and execution of our most sensitive and secure government agency clients.

Recruitment 107

Recruitment Big Data Machine Learning Government 107

Data Engineering Podcast

OCTOBER 19, 2020

Summary In order for analytics and machine learning projects to be useful, they require a high degree of data quality. To ensure that your pipelines are healthy you need a way to make them observable. In this episode Barr Moses and Lior Gavish, co-founders of Monte Carlo, share the leading causes of what they refer to as data downtime and how it manifests.

Machine Learning 100

Machine Learning Data Engineer Data Engineering Data 100

Netflix Tech

OCTOBER 19, 2020

by Maulik Pandey Our Team?—? Kevin Lew , Narayanan Arunachalam , Elizabeth Carretto , Dustin Haffner , Andrei Ushakov, Seth Katz , Greg Burrell , Ram Vaithilingam , Mike Smith and Maulik Pandey “ @Netflixhelps Why doesn’t Tiger King play on my phone?”?—?a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?

Building 95

Building Transportation Java Metadata 95

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

Confluent

OCTOBER 21, 2020

Every organization that exposes its services online is subject to the interest of malicious actors. The ongoing struggle with botnets, crawlers, script kiddies, and bounty hunters is challenging and requires […].

Management 116

Management IT Retail Kafka 116

Cloudera

OCTOBER 20, 2020

Introduction. Today we are introducing a new series of blog posts that will take a look at recent enhancements to Apache Impala. Many of these are performance improvements, such as the feature described below which will give anywhere from a 2x to 7x performance improvement by taking better advantage of all the CPU cores. In addition, a lot of work has also been put into ensuring that Impala runs optimally in decoupled compute scenarios, where the data lives in object storage or remote HDFS.

Utilities 105

Utilities Data Warehouse Cloud SQL 105

Teradata

OCTOBER 21, 2020

Two major forces impacting IT are on a collision course: the desire for a “modern data architecture” and businesses' need for data analytics. Find out more.

Architecture 52

Architecture Data Architecture Data Analytics IT 52

Confluent

OCTOBER 22, 2020

It’s important to be able to limit memory consumption of a running service. Use too much, and your application will crash and need to restart. If this happens too often, […].

Process 109

Process 109

Cloudera

OCTOBER 21, 2020

The Insurance industry is in uncharted waters and COVID-19 has taken us where no algorithm has gone before. Today’s models, norms, and averages are being re-written on the fly, with insurers forced to cope with the inevitable conflict between old standards and the new normal. . Take the restaurants of New York City suing their insurers for hundreds of millions of dollars.

Insurance 77

Insurance Unstructured Data Hospitality Media 77

Cloudera

OCTOBER 22, 2020

Cloudera recently appointed its first-ever Chief Diversity Officer, Sarah Shin. To maintain transparency about our diversity and inclusion (D&I) progress, we’ve asked her to share her vision for Cloudera’s future, and the initial steps she’s taking to help us get there. Q1: What drew you to work in the D&I space? . As a biracial woman, diversity and inclusion was a large part of my life before I even knew what it meant.

Building 70

Building Programming Finance Education 70

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Cloudera

OCTOBER 22, 2020

Replication ( covered in this previous blog article ) has been released for a while and is among the most used features of Apache HBase. Having clusters replicating data with different peers is a very common deployment, whether as a DR strategy or simply as a seamless way of replicating data between production/staging/development environments. Although it is an efficient way of keeping different HBase databases in sync within a sub-second latency, replication only operates over data ingested aft

Bytes 65

Bytes Datasets Data Data Ingestion 65

Teradata

OCTOBER 21, 2020

There is a lot of debate about what Modern Architecture means & what it actually comprises. However, the two terms that come up the most often are: simplicity & flexibility.

Architecture 52

Architecture IT 52

Teradata

OCTOBER 20, 2020

In part 2 of this series, we will cover techniques for defining & gathering availability requirements and making sure your business continuity solution provides the most potential ROI.

52

52

Teradata

OCTOBER 19, 2020

Marketing is essential. It drives revenue and is a big investment for banks. But marketers cannot grow the size of the pie – only their slice of it. Read more.

Banking 52

Banking IT 52

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud