Towards Data Science

JANUARY 16, 2024

Image by the author 2004 to 2010 — The elephant enters the room New wave of applications emerged — Social Media, Software observability, etc. Result: Hadoop & NoSQL frameworks emerged. Result: Companies started to sell pre-configured data warehouses as products. The concept of `Data Marts` was introduced.

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

Knowledge Hut

DECEMBER 26, 2023

Facebook It is a social media platform created originally by Mark Zuckerberg for college students in 2004. Most of the Data engineers working in the field enroll themselves in several other training programs to learn an outside skill, such as Hadoop or Big Data querying, alongside their Master's degree and PhDs.

Data Engineer 98

Data Engineer Data Engineering Engineering Pipeline-centric 98

ProjectPro

JUNE 6, 2025

Allows integration with other systems - Python is beneficial for integrating multiple scripts and other systems, including various databases (such as SQL and NoSQL databases), data formats (such as JSON, Parquet, etc.), Spark is incredibly fast in comparison to other similar frameworks like Apache Hadoop. and web services.

Data Analysis Tools 45

Data Analysis Tools Data Analysis BI R (Programming) 45

ProjectPro

JUNE 6, 2015

Solocal has taken big data to the next stage of BI by designing a novel vision of BI with the open source distributed computing framework Hadoop. It replaced its traditional BI structure by integrating big data and Hadoop."-April In BI – there is a need to use ETL on top of Hadoop as there is not much scripting.

Business Intelligence 40

Business Intelligence Big Data BI Hadoop 40