Towards Data Science

JANUARY 16, 2024

Image by the author 2004 to 2010 — The elephant enters the room New wave of applications emerged — Social Media, Software observability, etc. Result: Hadoop & NoSQL frameworks emerged. Result: Companies started to sell pre-configured data warehouses as products. The concept of `Data Marts` was introduced.

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

Knowledge Hut

DECEMBER 26, 2023

Facebook It is a social media platform created originally by Mark Zuckerberg for college students in 2004. Most of the Data engineers working in the field enroll themselves in several other training programs to learn an outside skill, such as Hadoop or Big Data querying, alongside their Master's degree and PhDs.

Data Engineering 98

Data Engineering Data Engineer Engineering Hadoop 98

Ascend.io

FEBRUARY 15, 2023

Back in 2004, I got to work with MapReduce at Google years before Apache Hadoop was even released, using it on a nearly daily basis to analyze user activity on web search and analyze the efficacy of user experiments. I’ve had the good fortune to work at or start companies that were breaking new ground. Big data would be a big deal.

Cloud 52

Cloud Amazon Web Services Hadoop Telecommunication 52

Ascend.io

FEBRUARY 15, 2023

Back in 2004, I got to work with MapReduce at Google years before Apache Hadoop was even released, using it on a nearly daily basis to analyze user activity on web search and analyze the efficacy of user experiments. I’ve had the good fortune to work at or start companies that were breaking new ground. Big data would be a big deal.

Cloud 52

Cloud Amazon Web Services Hadoop Telecommunication 52

Zalando Engineering

FEBRUARY 28, 2018

For the sake of comparison, let’s recap the Hadoop way of working: Hadoop saves intermediate states to disk and communicates over a network. In fact, in a 2004 mapReduce research paper the designer states that key-value pairs is a key choice in designing mapReduce. Provides in memory storage for cached RDD’s.

Data Analysis 40

Data Analysis Hadoop SQL Datasets 40

Cloudera

DECEMBER 12, 2018

Greg Rahn: Toward the end of that eight-year stint, I saw this thing coming up called Hadoop and an engine called Hive. In the Hadoop world, or the big data world, most of these components are separate and modular, but yet interact together to form a system that behaves very similarly. Say, circa 2004 when I started at Oracle.

Data Warehouse 42

Data Warehouse Relational Database Hadoop Database 42

ProjectPro

JUNE 6, 2015

Solocal has taken big data to the next stage of BI by designing a novel vision of BI with the open source distributed computing framework Hadoop. It replaced its traditional BI structure by integrating big data and Hadoop."-April In BI – there is a need to use ETL on top of Hadoop as there is not much scripting.

Business Intelligence 40

Business Intelligence Big Data BI Hadoop 40