Data Engineering Weekly

DECEMBER 21, 2022

The Rise of Data Modeling Data modeling has been one of the hot topics in Data LinkedIn. Hadoop put forward the schema-on-read strategy that leads to the disruption of data modeling techniques as we know until then. Let’s reference what the data world looked like before the Hadoop era.

Data Engineering 57

Data Engineering Data Engineer Engineering Hadoop 57

ProjectPro

NOVEMBER 24, 2014

With a rapid pace in evolution of Big Data, its processing frameworks also seem to be evolving in a full swing mode. Hadoop (Hadoop 1.0) has progressed from a more restricted processing model of batch oriented MapReduce jobs to developing specialized and interactive processing models (Hadoop 2.0).

Hadoop 40

Hadoop Programming Big Data Unstructured Data 40

Rockset

OCTOBER 30, 2018

If a data processing task that takes 100 minutes on a single CPU could be reconfigured to run in parallel on 100 CPUs in 1 minute, then the price of computing this task would remain the same, but the speedup would be tremendous! Hadoop and RocksDB are two examples I’ve had the privilege of working on personally.

Cloud 40

Cloud IT MongoDB Hadoop 40

ProjectPro

NOVEMBER 15, 2021

With SQL, machine learning, real-time data streaming, graph processing, and other features, this leads to incredibly rapid big data processing. DataFrames are used by Spark SQL to accommodate structured and semi-structured data. Online Analytical Processing(OLAP) is a term used to describe these workloads.

Big Data 52

Big Data Project Metadata Programming Language 52