Sat.Apr 04, 2020 - Fri.Apr 10, 2020

article thumbnail

Preventing Fraud and Fighting Account Takeovers with Kafka Streams

Confluent

Many companies have recently started to take cybersecurity and data protection even more seriously, particularly driven by the recent General Data Protection Regulation (GDPR) legislation. They are increasing their investment […].

Kafka 145
article thumbnail

Review: Building a Real Time Data Warehouse

Start Data Engineering

Many data engineers coming from traditional batch processing frameworks have questions about real time data processing systems, like “What kind of data model did you implement, for real-time processing?

article thumbnail

Teradata Supports China’s Fight Against COVID-19

Teradata

By fully utilizing the data for telco operators in China, Teradata helped communities battle the COVID-19 epidemic through ongoing public health communication, travel updates and inquiries.

Utilities 111
article thumbnail

Building A Knowledge Graph Of Commercial Real Estate At Cherre

Data Engineering Podcast

Summary Knowledge graphs are a data resource that can answer questions beyond the scope of traditional data analytics. By organizing and storing data to emphasize the relationship between entities, we can discover the complex connections between multiple sources of information. In this episode John Maiden talks about how Cherre builds knowledge graphs that provide powerful insights for their customers and the engineering challenges of building a scalable graph.

Building 100
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Confluent Cloud KSQL is Now Available

Confluent

Today, we are excited to announce that after a highly productive period of being in private preview, Confluent Cloud KSQL is now production ready and available to all Confluent Cloud […].

Cloud 96
article thumbnail

3 Key Points to Help You Partition Late Arriving Events

Start Data Engineering

One of the most common issues when ingesting and processing user generated events is, how to deal with late arriving events. Yet this topic is not extensively discussed. Some of the general issues that data engineers usually have are “What should be considered the event time?

More Trending

article thumbnail

Understanding Spark Query Plans

Rock the JVM

In this article, you'll learn one of the most important Spark skills: reading how your job will run, which is foundational for any further Spark optimization

52
article thumbnail

How the New Confluent Hub Makes Finding Connectors Easier Than Ever

Confluent

Confluent Hub launched in 2018 as a place to discover and share Apache Kafka® and Confluent Platform plugins. Users have found the site a much better place to discover useful […].

Kafka 85
article thumbnail

I’m Sorry CXOs, but You’re Mostly Doing Analytics All Wrong

Teradata

There is no ROI in technology - specifically in data analytics, AI & Machine Learning - until we deploy in production and change the way we do business.

article thumbnail

Connect Teradata Vantage to Azure Data Factory Using Custom Activity Feature

Teradata

Teradata customers are interested in integrating Vantage with Microsoft Azure First Party Services. This Getting Started Guide will help you connect Teradata Vantage using Azure Data Factory Custom Activity feature.

Data 59
article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

I’m Sorry CXOs, but You’re Mostly Doing Analytics All Wrong

Teradata

There is no ROI in technology - specifically in data analytics, AI & Machine Learning - until we deploy in production and change the way we do business.

article thumbnail

Understanding Spark Query Plans

Rock the JVM

In this article, you'll learn one of the most important Spark skills: reading how your job will run, which is foundational for any further Spark optimization

52
article thumbnail

Things That Don't Make Sense: Scala Variables

Rock the JVM

Daniel shares a candid rant on the challenges of learning and teaching Scala with variables

Scala 52
article thumbnail

Things That Don't Make Sense: Scala Variables

Rock the JVM

Daniel shares a candid rant on the challenges of learning and teaching Scala with variables

Scala 52
article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Higher-Order Functions for Object-Oriented Programmers

Rock the JVM

For OO programmers looking to dive into functional programming in Scala: a gentle introduction to functions working with other functions

Scala 52