Knowledge Hut

JUNE 26, 2023

Given that the United States has had the highest inflation rate since 2008, this is a significant problem. The author utilised petabytes of website data from the Common Crawl in their effort. This is also another excellent example of putting together and showing a data engineering project, in my opinion.

Data Engineering 98

Data Engineering Data Engineer Coding Project 98

Rockset

OCTOBER 4, 2022

Streaming data feeds many real-time analytics applications, from logistics tracking to real-time personalization. Event streams, such as clickstreams, IoT data and other time series data, are common sources of data into these apps. The software was subsequently open sourced in 2016.

MySQL 52

MySQL Kafka Aggregated Data Architecture 52

ProjectPro

SEPTEMBER 6, 2021

Google launched its Cloud Platform in 2008, six years after Amazon Web Services launched in 2002. But not long after Google launched GCP in 2008, it began gaining market traction. Popular instances where GCP is used widely are machine learning analytics, application modernization, security, and business collaboration.

AWS 52

AWS Amazon Web Services Google Cloud Cloud Storage 52

ProjectPro

MARCH 15, 2016

These days we notice that many banks compile separate data warehouses into a single repository backed by Hadoop for quick and easy analysis. Hadoop has helped the financial sector, maintain a better risk record in the aftermath of 2008 economic downturn. Load a historical transactional point of sales data, into a Hadoop cluster.

Hadoop 40

Hadoop Retail Healthcare Banking 40

ProjectPro

MARCH 10, 2016

The biggest professional network consumes tons of data from multiple sources for analysis, in its Hadoop based data warehouses. The process of funnelling data into Hadoop systems is not as easy as it appears, because data has to be transferred from one location to a large centralized system.

Hadoop 40

Hadoop Big Data Data Analytics Big Data Ecosystem 40