Brief History of Data Engineering
Jesse Anderson
DECEMBER 12, 2022
Google looked over the expanse of the growing internet and realized they’d need scalable systems. With an immutable file system like HDFS, we needed scalable databases to read and write data randomly. Apache Spark came in 2009 and gave a unified batch and streaming engine. We lacked a scalable pub/sub system.
Let's personalize your content