ThoughtSpot

SEPTEMBER 6, 2023

The pathway from ETL to actionable analytics can often feel disconnected and cumbersome, leading to frustration for data teams and long wait times for business users. And even when we manage to streamline the data workflow, those insights aren’t always accessible to users unfamiliar with antiquated business intelligence tools.

Data Workflow 105

Data Workflow Raw Data Data Lake Business Intelligence 105

Striim

SEPTEMBER 11, 2024

Third-Party Data: External data sources that your company does not collect directly but integrates to enhance insights or support decision-making. These data sources serve as the starting point for the pipeline, providing the raw data that will be ingested, processed, and analyzed.

Data Pipeline 98

Data Pipeline Designing Data Lake Data Warehouse 98

Ascend.io

DECEMBER 11, 2023

When data is infrequently updated or accessed, it’s possible to utilize raw data directly to fulfill business objectives, provided that cost and performance metrics are met. However, this approach quickly shows its limitations as data volume escalates. So, why is data orchestration a big deal?

Data Workflow 52

Data Workflow Data Pipeline Data Lake Data 52

Hepta Analytics

FEBRUARY 14, 2022

This week, we got to think about our data ingestion design. We looked at the following: How do we ingest – ETL vs ELT Where do we store the data – Data lake vs data warehouse Which tool to we use to ingest – cronjob vs workflow engine NOTE : This weeks task requires good internet speed and good compute.

Data Ingestion 52

Data Ingestion Data Engineer Data Engineering Engineering 52

Databand.ai

AUGUST 30, 2023

DataOps is a collaborative approach to data management that combines the agility of DevOps with the power of data analytics. It aims to streamline data ingestion, processing, and analytics by automating and integrating various data workflows.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52

Data Engineering Weekly

JANUARY 15, 2023

. 🎯 I defined the modern data stack sometime back as; @sarahmk125 MDS is a set of vendor tools that solve niche data problems (lineage, orchestration, quality) with the side effect of creating a disjointed data workflow that makes data folks lives more complicated.","username":"ananthdurai","name":"at-ananth-at-data-folks

Data Engineer 52

Data Engineer Data Engineering Engineering Metadata 52

Ripple Engineering

MAY 27, 2021

At Ripple , we are moving towards building complex business models out of raw data. A prime example of this was the process of managing our data transformation workflows. This enables our analysts to focus on data curation and modelling rather than infrastructure. SQL Models A model is a single.sql file.

Building 52

Building Raw Data SQL Data 52