Big Data Ecosystem, Bytes, Scala and SQL

A Beginners Guide to Spark Streaming Architecture with Example

ProjectPro

DECEMBER 28, 2021

Spark Streaming was launched in 2013 to enable data engineers and data scientists to process real-time data from SQL databases, Flume, Amazon Kinesis, etc. Discretized Streams, or DStreams, are fundamental abstractions here, as they represent streams of data divided into small chunks(referred to as batches).

Architecture

Architecture Kafka Java Scala

Hadoop MapReduce vs. Apache Spark Who Wins the Battle?

ProjectPro

NOVEMBER 11, 2014

This blog helps you understand the critical differences between two popular big data frameworks. Hadoop and Spark are popular apache projects in the big data ecosystem. Apache Spark is an improvement on the original Hadoop MapReduce component of the Hadoop big data ecosystem.

Hadoop

Hadoop Scala Machine Learning Java

Data Engineering Digest

A Beginners Guide to Spark Streaming Architecture with Example

Hadoop MapReduce vs. Apache Spark Who Wins the Battle?

Webinars

Stay Connected