Maxime Beauchemin

JANUARY 20, 2017

The fact that ETL tools evolved to expose graphical interfaces seems like a detour in the history of data processing, and would certainly make for an interesting blog post of its own. Let’s highlight the fact that the abstractions exposed by traditional ETL tools are off-target.

Data Engineer 130

Data Engineer Data Engineering Engineering ETL Tools 130

Lyft Engineering

OCTOBER 3, 2023

High-quality data is necessary for the success of every data-driven company. It is now the norm for tech companies to have a well-developed data platform. This makes it easy for engineers to generate, transform, store, and analyze data at the petabyte scale. Beginning backtest for 1 date(s) and 1 check(s).

Big Data 90

Big Data Metadata Data Warehouse Data 90

Monte Carlo

DECEMBER 19, 2022

Too much data Too much data might not sound like a problem (it is called big data afterall), but when rows populate out of proportion, it can slow model performance and increase compute costs. Essentially, does this data reflect reality? In this case, the SLI would be something like “hours since dataset refreshed.”

High Quality Data 52

High Quality Data Data SQL Bytes 52

Monte Carlo

OCTOBER 5, 2023

Ensure data quality Even if there are no errors during the ETL process, you still have to make sure the data meets quality standards. High-quality data is crucial for accurate analysis and informed decision-making. Different perspectives can often shed light on elusive issues.

Data Cleanse 52

Data Cleanse ETL Tools Datasets Utilities 52

Monte Carlo

OCTOBER 10, 2024

As the use of AI becomes more ubiquitous across data organizations and beyond, data quality rises in importance right alongside it. After all, you can’t have high-quality AI models without high-quality data feeding them. Machine Learning Basics : Understanding how data impacts model training.

Unstructured Data 52

Unstructured Data Google Cloud Machine Learning ETL Tools 52

Monte Carlo

AUGUST 9, 2023

Too much data Too much data might not sound like a problem (it is called big data afterall), but when rows populate out of proportion, it can slow model performance and increase compute costs. Volume tests It’s important to identify data volume changes as quickly as possible.

Finance 52

Finance SQL High Quality Data Data 52

Databand.ai

JUNE 14, 2023

It enables: Enhanced decision-making: Accurate and reliable data allows businesses to make well-informed decisions, leading to increased revenue and improved operational efficiency. Risk mitigation: Data errors can result in expensive mistakes or even legal issues.

Amazon Web Services 40

Amazon Web Services Datasets High Quality Data ETL Tools 40