article thumbnail

A Multipurpose Database For Transactions And Analytics To Simplify Your Data Architecture With Singlestore

Data Engineering Podcast

Singlestore aims to cut down on the number of database engines that you need to run so that you can reduce the amount of copying that is required. By supporting fast, in-memory row-based queries and columnar on-disk representation, it lets your transactional and analytical workloads run in the same database.

Database 100
article thumbnail

Modern Customer Data Platform Principles

Data Engineering Podcast

Summary Databases and analytics architectures have gone through several generational shifts. Your first three Miro boards are free when you sign up today at [dataengineeringpodcast.com/miro]([link] Support Data Engineering Podcast Summary Databases and analytics architectures have gone through several generational shifts.

Data Lake 147
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Spotter: Your AI Analyst

ThoughtSpot

One of the complexities of real-life business questions is that the information required to do the analysis or calculation doesnt always exist as a simple database column. The complexity escalates further when the question requires adding additional analytical concepts like a cohort analysis, grouping, and more.

BI 59
article thumbnail

Beyond Kafka: Conversation with Jark Wu on Fluss - Streaming Storage for Real-Time Analytics

Data Engineering Weekly

Kafka is designed for streaming events, but Fluss is designed for streaming analytics. Architecture Difference The first difference is the Data Model. Instead of Kafka's topics, Fluss organizes data into database tables with partitions and buckets. Fluss aims to be the best storage for Flink and real-time analytics.

Kafka 74
article thumbnail

An Exploration Of The Expectations, Ecosystem, and Realities Of Real-Time Data Applications

Data Engineering Podcast

With their new managed database service you can launch a production ready MySQL, Postgres, or MongoDB cluster in minutes, with automated backups, 40 Gbps connections from your application hosts, and high throughput SSDs. Just connect it to your database/data warehouse/data lakehouse/whatever you’re using and let them do the rest.

article thumbnail

A Prequel to Data Mesh

Towards Data Science

Evolution of the data landscape 1980s — Inception Relational databases came into existence. Organizations began to use relational databases for ‘everything’. Databases were overwhelmed with transactional and analytical workloads. Image by the author Early 1990s — Scale Analytical workloads started to get complex.

article thumbnail

How to Use KSQL Stream Processing and Real-Time Databases to Analyze Streaming Data in Kafka

Rockset

In this post, I’ll discuss some common real-time analytics use-cases that we have seen with our customers here at Rockset and how different real-time analytics architectures suit each of them. We’ll discuss what a sample architecture might look like for each.

Kafka 40