Cloudera

JANUARY 20, 2021

In this last installment, we’ll discuss a demo application that uses PySpark.ML to make a classification model based off of training data stored in both Cloudera’s Operational Database (powered by Apache HBase) and Apache HDFS. As a result, I decided to use an open-source Occupancy Detection Data Set to build this application.

Machine Learning 115

Machine Learning Database Data Science Building 115

Snowflake

OCTOBER 22, 2024

Welcome to Snowflake’s Startup Spotlight, where we ask startup founders about the problems they’re solving, the apps they’re building, and the lessons they’ve learned during their startup journey. It’s basically an “easy button” for synthetic data. You can even train ML models on our synthetic data, or use it for data sharing purposes.

Data 82

Data Data Schemas Datasets Machine Learning 82

Engineering at Meta

FEBRUARY 7, 2023

We’re Meta now, but our mission remains the same: Giving people the power to build community and bring the world closer together. This new data schema was born partly out of our cartographic tiling logic, and it includes everything necessary to make a map of the world. Icon versus icon Our initial basemaps eschewed icons.

Entertainment 138

Entertainment Transportation Data Schemas AWS 138

Striim

SEPTEMBER 11, 2024

In this guide, we’ll dive into everything you need to know about data pipelines—whether you’re just getting started or looking to optimize your existing setup. We’ll answer the question, “What are data pipelines?” Then, we’ll dive deeper into how to build data pipelines and why it’s imperative to make your data pipelines work for you.

Data Pipeline 98

Data Pipeline Designing Data Lake Data Warehouse 98

Workfall

SEPTEMBER 18, 2023

Pre-filter and pre-aggregate data at the source level to optimize the data pipeline’s efficiency. Adapt to Changing Data Schemas: Data sources aren’t static; they evolve. Account for potential changes in data schemas and structures.

Data Pipeline 93

Data Pipeline Raw Data Data Schemas Healthcare 93

dbt Developer Hub

FEBRUARY 7, 2022

It includes a set of demo CSV files, which you can use as dbt seeds to test Donny's project for yourself. If not, I’d recommend taking a second to look at Claire Carroll’s README for the original Jaffle Shop demo project (otherwise this playbook is probably going to be a little weird, but still useful, to read).

Data Warehouse 52

Data Warehouse Datasets Data SQL 52

Monte Carlo

OCTOBER 11, 2022

Unbeknownst to you, the training data contains a table with aggregated visitor website data with columns that haven’t been updated in a month. It turns out the marketing operations team upgraded to Google Analytics 4 to get ahead of the July 2023 deadline which changed the data schema.

IT 52

IT Datasets Data Warehouse Data Analysis 52