Data Engineering Podcast

JANUARY 21, 2024

Summary Databases and analytics architectures have gone through several generational shifts. Trusted by teams of all sizes, including Comcast and Doordash, Starburst is a data lake analytics platform that delivers the adaptability and flexibility a lakehouse ecosystem promises. Want to see Starburst in action?

Data Lake 147

Data Lake High Quality Data NoSQL Data Warehouse 147

Towards Data Science

JANUARY 16, 2024

My personal take on justifying the existence of Data Mesh A senior stakeholder at one my projects mentioned that they wanted to decentralise their data platform architecture and democratise data across the organisation. When I heard the words ‘decentralised data architecture’, I was left utterly confused at first! Where did I look?

Data Warehouse 95

Data Warehouse Data Architecture Relational Database NoSQL 95

Data Engineering Podcast

AUGUST 21, 2022

Ascend users love its declarative pipelines, powerful SDK, elegant UI, and extensible plug-in architecture, as well as its support for Python, SQL, Scala, and Java. Can you describe what is driving the adoption of real-time analytics? Can you describe what is driving the adoption of real-time analytics?

Lambda Architecture 100

Lambda Architecture MongoDB MySQL Scala 100

RudderStack

MAY 16, 2023

Find out why companies are leaving Google Analytics, and learn how to replace it with a warehouse-native analytics architecture.

Analytics Architecture 76

Analytics Architecture Architecture IT 76

DataKitchen

AUGUST 19, 2021

Below is our fourth post (4 of 5) on combining data mesh with DataOps to foster innovation while addressing the challenges of a decentralized architecture. The analytics team is under tremendous pressure during the early phases of the drug’s lifetime. Figure 3: Example DataOps architecture based on the DataKitchen Platform.

Pharmaceutical 98

Pharmaceutical Data Lake Data Warehouse Raw Data 98

Teradata

OCTOBER 26, 2020

Identify the true capabilities of a modern analytics architecture and achieve what really matters: answers. Find out more.

Analytics Architecture 59

Analytics Architecture Cloud Architecture 59

Data Engineering Weekly

NOVEMBER 13, 2022

link] Uber: Uber Freight Near-Real-Time Analytics Architecture Uber writes about its Uber Fright architecture highlighting how it archives data freshness, latency, reliability, and accuracy. The blog narrates the design of the data collection, modeling & visualization layers.

Data Engineering 52

Data Engineering Data Engineer Engineering Kafka 52

Monte Carlo

JULY 25, 2022

But one thing’s for sure: if you can’t trust the data powering your analytics architecture, it’s hard to justify the investment. It’s a paradigm shift, an architectural framework, a popular trend, and a source of certain misconceptions in the data engineering community. The data mesh contains multitudes.

Government 52

Government Data Architecture Insurance 52

Striim

AUGUST 22, 2024

“Sometimes there’s so much data that old batch processing (late at night once a day or once a week) just doesn’t have time to move all data and hence the only way to do it is trickle feed data via CDC,” says Dmitriy Rudakov, Director of Solution Architecture at Striim.

Data Warehouse 52

Data Warehouse Retail Machine Learning Database 52

Monte Carlo

FEBRUARY 9, 2022

“[Insights is] a new and powerful way to understand what data assets matter most to our business and how we can better drive an impact with our data across the organization,” s aid Valerie Rogoff , Director of Data Analytics Architecture at ShopRunner.

Raw Data 52

Raw Data Analytics Architecture Data Data Analytics 52

Knowledge Hut

JUNE 23, 2023

Real-time data analytics is an essential innovation that enables companies to act quickly on data. This demonstrates the rising significance of real-time analytics architecture in the hectic corporate climate of today. Analytics will continue to allow more adaptable and real-time decision-making in 2023.

Data Analytics 52

Data Analytics IT Transportation Analytics Architecture 52

Rockset

JULY 8, 2021

Shrey Batra comes from LinkedIn and Innovaccer, two companies with particularly data-intensive products, so I'm really interested to hear what type of real-time analytics architectures he's had experience with that employ MongoDB Change Streams.

MongoDB 40

MongoDB Manufacturing Analytics Architecture Architecture 40

ThoughtSpot

JUNE 24, 2024

This entire experience can only come together the way it has with the right analytics architecture, semantic engine, and consumer UX. With the same AI-powered ThoughtSpot features you love, like NLQ and SpotIQ, embedded in your application, you can deliver on this massive wave of opportunity created by GenAI.

BI 59

BI Analytics Architecture SQL Cloud 59

Rockset

MARCH 19, 2020

In this post, I’ll discuss some common real-time analytics use-cases that we have seen with our customers here at Rockset and how different real-time analytics architectures suit each of them. We’ll discuss what a sample architecture might look like for each.

Kafka 40

Kafka Database Process SQL 40

Knowledge Hut

FEBRUARY 27, 2023

Some of the most common responsibilities of data engineers include Data collection Matching the architecture to the business his needs Discovering tasks that can be automated using data Using advanced analytics programs, machine learning, and statistical techniques Updating stakeholders based on analytics Architecture development, building, testing, (..)

Data Engineering 52

Data Engineering Data Engineer Database-centric Pipeline-centric 52

ArcGIS

FEBRUARY 20, 2025

The integration of AutoCAD, Civil 3D, digital models (Revit), and ArcGIS Pro combines the strengths of each system

Systems 101

Systems Analytics Architecture Data Integration Data Management 101

ArcGIS

FEBRUARY 21, 2025

Use BIM Cloud Connection in ArcGIS Pro to import CAD and BIM data and automate steps in publishing web scenes using a rail project scenario.

Cloud 101

Cloud Project Analytics Architecture Data 101

ArcGIS

FEBRUARY 21, 2025

This deep dive walks GIS analysts through steps for automated publishing of CAD and BIM data using scene layer packages

Analytics Architecture 98

Analytics Architecture Data Data Management Architecture 98

ArcGIS

JUNE 21, 2023

Check out exciting sessions, special interest groups and activities on BIM, CAD, and GIS integrations featured at Esri UC 2023.

Analytics Architecture 98

Analytics Architecture Designing Architecture Engineering 98

ArcGIS

FEBRUARY 3, 2025

Explore how Dar used ArcGIS CityEngine for procedural urban design to transform a brownfield into a vibrant waterfront destination in Jeddah.

Designing 89

Designing Analytics Architecture Architecture Engineering 89

Edureka

FEBRUARY 7, 2023

It allows developers to query external data from supported data stores transparently, regardless of the storage architecture of the external data store. One can use polybase: From Azure SQL Database or Azure Synapse Analytics, query data kept in Hadoop, Azure Blob Storage, or Azure Data Lake Store.

Data Engineering 52

Data Engineering Data Engineer Engineering Hadoop 52

ArcGIS

NOVEMBER 8, 2023

Surfaces in a centralized location

Datasets 67

Datasets Analytics Architecture Data Management Architecture 67

ArcGIS

NOVEMBER 8, 2023

Terrain datasets as ground—Create scenes in ArcGIS Pro and publish to ArcGIS Online

Datasets 67

Datasets Analytics Architecture Data Management Architecture 67

ArcGIS

NOVEMBER 8, 2023

Surface modeling across Autodesk Civil 3D and ArcGIS Pro 3.2 using newly supported feature classes

Analytics Architecture 67

Analytics Architecture Datasets Data Management Architecture 67

ArcGIS

FEBRUARY 21, 2025

This deep dive walks GIS analysts through steps for automated publishing of CAD and BIM data using building scene layers.

Building 57

Building Analytics Architecture Data Data Management 57

ArcGIS

MAY 22, 2024

Defining the Topography feature class as current ground to visualize underground Autodesk Civil 3D components.

Designing 57

Designing Analytics Architecture Architecture Engineering 57

ArcGIS

MAY 22, 2024

Defining the Topography feature class as current ground to visualize underground Autodesk Civil 3D components.

Designing 57

Designing Analytics Architecture Architecture Engineering 57

Towards Data Science

MAY 22, 2023

Markus Stadi is a Senior Cloud Data Engineer at Dehn SE working in the field of Data Engineering, Data Science and Data Analytics for many years. Lukas Berle is a Data Architect at TeamBank AG specialized in the design and implementation of robust data analytics architectures.

Data Engineering 98

Data Engineering Data Engineer Engineering Data Science 98

Monte Carlo

MAY 17, 2023

This applies especially to your data architecture. “That’s the beauty of Monte Carlo because it allows us to see who is using data and where it is being consumed,” said Valerie Rogoff, former director of analytics architecture, ShopRunner. ” 36.

Data 52

Data Data Pipeline Data Engineering Data Engineer 52

Monte Carlo

MAY 17, 2023

This applies especially to your data architecture. “That’s the beauty of Monte Carlo because it allows us to see who is using data and where it is being consumed,” said Valerie Rogoff, former director of analytics architecture, ShopRunner. ” 36.

Data Pipeline 52

Data Pipeline Data Engineering Data Engineer Data 52

ArcGIS

MARCH 2, 2025

Automating these workflows, can seamlessly connect design data with GIS platforms, ensuring an efficient, data-driven approach.

Designing 57

Designing Data Analytics Architecture Building 57