Workfall

JULY 4, 2023

Imagine a team of skilled data engineers on an exciting quest to transform raw data into a treasure trove of insights. With DBT, they weave powerful SQL spells to create data models that capture the essence of their organization’s information. The data warehouse, role, database, schema, credentials, etc.

Data Warehouse 69

Data Warehouse SQL PostgreSQL Database 69

Knowledge Hut

JUNE 28, 2023

Data Sources Diverse and vast data sources, including structured, unstructured, and semi-structured data. Structured data from databases, data warehouses, and operational systems. Goal Extracting valuable information from raw data for predictive or descriptive purposes.

Data Mining 52

Data Mining Business Intelligence BI Structured Data 52

Monte Carlo

AUGUST 31, 2023

Understanding the “rise of data downtime” With a greater focus on monetizing data coupled with the ever present desire to increase data accuracy, we need to better understand some of the factors that can lead to data downtime. We’ll take a closer look at variables that can impact your data next.

Data Lake 52

Data Lake Data Pipeline Unstructured Data Data Warehouse 52

DataKitchen

SEPTEMBER 21, 2023

Data in Place refers to the organized structuring and storage of data within a specific storage medium, be it a database, bucket store, files, or other storage platforms. In the contemporary data landscape, data teams commonly utilize data warehouses or lakes to arrange their data into L1, L2, and L3 layers.

Raw Data 67

Raw Data Data Business Intelligence High Quality Data 67

DataKitchen

JULY 27, 2023

Azure Databricks Delta Live Table s: These provide a more straightforward way to build and manage Data Pipelines for the latest, high-quality data in Delta Lake. Azure Blob Storage serves as the data lake to store raw data. SQL Server Integration Services (SSIS): You know it; your father used it.

Data Pipeline 52

Data Pipeline BI Machine Learning Data Preparation 52

Monte Carlo

APRIL 24, 2023

Data ingestion When we think about the flow of data in a pipeline, data ingestion is where the data first enters our platform. There are two primary types of raw data.

Data Pipeline 52

Data Pipeline Building Data Ingestion BI 52

Monte Carlo

AUGUST 30, 2023

Often, teams run custom data tests as part of a deployment pipeline, or scheduled on production systems via job schedulers like Apache Airflow, dbt Cloud, or via in-built schedulers in your data warehouse solution. Once the models are created and data transformed, `dbt test` should be executed.

SQL 52

SQL Datasets Database High Quality Data 52