Yelp Engineering

JANUARY 29, 2023

This blog post deep dives into how we rebuilt one of our Cassandra(C*) clusters by removing malformed data using Yelp’s Data Pipeline. Apache Cassandra is a distributed wide-column NoSQL datastore and is used at Yelp for storing both primary and derived data. Many different features on Yelp are powered by Cassandra.

Data Pipeline 75

Data Pipeline NoSQL Manufacturing Data 75

Data Engineering Podcast

FEBRUARY 9, 2020

Links SnowflakeDB Data Vault Modeling Data Warrior Blog OLTP == On-Line Transaction Processing Data Warehouse Bill Inmon Claudia Imhoff Oracle DB Third Normal Form Star Schema Snowflake Schema Relational Theory Sixth Normal Form Denormalization Pivot Table Dan Linstedt TDAN.com Ralph Kimball Agile Manifesto Schema On Read Data Lake Hadoop NoSQL Data (..)

Data Lake 100

Data Lake Data Warehouse Hadoop NoSQL 100

Netflix Tech

MARCH 7, 2023

These media focused machine learning algorithms as well as other teams generate a lot of data from the media files, which we described in our previous blog , are stored as annotations in Marken. The solution which we present in this blog is not limited to annotations and can be used for any other domain which uses ES and Cassandra as well.

Data Ingestion 109

Data Ingestion Management Algorithm Media 109

Data Engineering Podcast

AUGUST 19, 2018

Contact Info @manishrjain on Twitter manishrjain on GitHub Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? What are your plans for the future of DGraph? What are your plans for the future of DGraph?

Database 100

Database PostgreSQL NoSQL Transportation 100

Cloudera

OCTOBER 13, 2020

CDP Operational Database (2) – an autonomous, multimodal, autoscaling database environment supporting both NoSQL and SQL. The post Happy Birthday, CDP Public Cloud appeared first on Cloudera Blog. Keep up with what’s new in CDP-PC by following our monthly release summaries. . (1) 1) Currently available on AWS only. (2)

Cloud 97

Cloud Data Warehouse Machine Learning AWS 97

Confluent

MAY 22, 2019

A scalable, distributed, peer-to-peer NoSQL database, Scylla is a perfect fit for consuming the variety, velocity, and volume of data (often time-series) coming directly from users, devices, and sensors spread across geographic locations. A version of this blog post was originally published on the Scylla blog. What is Scylla?

Kafka 98

Kafka Google Cloud NoSQL Entertainment 98

Workfall

MARCH 21, 2023

In this blog, we’ll explore: What is SurrealDB? SurrealDB is a NoSQL database, which eliminates the need for the majority of server-side components and layers that are typically required when using other types of database systems. For this blog, we shall use the nightly build. What is Jamstack? src/main.rs(1): 1): src/main.rs(2):

PostgreSQL 68

PostgreSQL NoSQL Database Unstructured Data 68

Cloudera

SEPTEMBER 1, 2022

In this blog, we’ll talk about Cloudera Operational Database (COD), a DBPaaS offering available on Cloudera Data Platform (CDP) that brings all the benefits of HBase without any of the overheads. First, COD provides both NoSQL and SQL approaches to querying data. COD in the Cloudera Data Platform (CDP). Flexible and multi-modal.

Database 84

Database Cloud NoSQL SQL 84

AltexSoft

MAY 14, 2021

Text mining is an advanced analytical approach used to make sense of Big Data that comes in textual forms such as emails, tweets, researches, and blog posts. NoSQL databases. NoSQL databases, also known as non-relational or non-tabular databases, use a range of data models for data to be accessed and managed.

Big Data 78

Big Data Data Analytics IT NoSQL 78

Cloudera

NOVEMBER 23, 2021

Although the HBase architecture is a NoSQL database, it eases the process of maintaining data by distributing it evenly across the cluster. The post Getting Started with Cloudera Data Platform Operational Database (COD) appeared first on Cloudera Blog. This makes accessing and altering data in the HBase data model quick.

Database 91

Database Non-relational Database NoSQL Government 91

DoorDash Engineering

MARCH 21, 2023

Maintenance overheads of large-scale Redis clusters If you read the prior blog post on our feature store (a must-read), you might be asking, ‘Why add another database?’ Sean Chittenden, Mike Czabator, Glenn Fawcett, Bryan Kwon The post Using CockroachDB to Reduce Feature Store Costs by 75% appeared first on DoorDash Engineering Blog.

Machine Learning 132

Machine Learning AWS Database Utilities 132

Edureka

AUGUST 26, 2024

In this blog, we will guide you through the “Web Developer Roadmap.” MongoDB is a NoSQL database where data are stored in a flexible way that is similar to JSON format. MongoDB is a NoSQL database used in web development. Are you prepared to enter? Then, let us begin! Express.js

MongoDB 97

MongoDB Programming Language MySQL Certification 97

Striim

MARCH 4, 2025

In this blog post, were going to unpack the critical differences between legacy systems and AI-driven approaches, demonstrating why when it comes to hackable data, AI-driven data governance is the only way to go. Thats where AI-powered data governance comes into play. Once the data is on the move, Sentinel AI steps in.

Data Governance 40

Data Governance Government Healthcare NoSQL 40

Cloudera

SEPTEMBER 24, 2021

They were using R and Python, with NoSQL and other open source ad hoc data stores, running on small dedicated servers and occasionally for small jobs in the public cloud. The post Telecom Network Analytics: Transformation, Innovation, Automation appeared first on Cloudera Blog.

Data Architect 96

Data Architect Government NoSQL Big Data 96

Cloudera

AUGUST 30, 2022

The post Breaking State and Local Data Silos with Modern Data Architectures appeared first on Cloudera Blog. Forrester ). To learn more about breaking down silos in the public sector with modern data architectures, watch our recent webinar “ Turn Siloed Data into Strategic Assets ” with Cloudera Solutions Engineer John Azariah. .

Data Architecture 79

Data Architecture Architecture Data Lake NoSQL 79

Cloudera

FEBRUARY 26, 2021

In the previous blog posts, we looked at application development concepts and how Cloudera Operational Database (COD) interacts with other CDP services. In this blog post, let us see how easy it is to create a COD instance, and deploy a sample application that runs on that COD instance. . Apache HBase (NoSQL), Java, Maven: Read-Write.

Database 61

Database Java NoSQL Programming Language 61

Cloudera

OCTOBER 6, 2020

It offers multi-modal client access with NoSQL key-value using Apache HBase APIs and relational SQL with JDBC (via Apache Phoenix). In this blog, I will demonstrate how COD can easily be used as a backend system to store data and images for a simple web application. Hope you find it useful, Happy coding!!

Database 81

Database Building Bytes NoSQL 81

Pinterest Engineering

JANUARY 4, 2024

While KVStore was the client facing abstraction, we also built a storage service called Rockstorewidecolumn : a wide column, schemaless NoSQL database built using RocksDB. Motivation As explained in this blog post , in 2019, Pinterest had four different key-value services with different storage engines including RocksDB, HBase, and HDFS.

Database 98

Database Building Datasets Relational Database 98

Cloudera

NOVEMBER 30, 2022

We have divided the “ Transaction Support in Cloudera Operational Database (COD)” blog into two parts. OMID enables big data applications to benefit from the best of both worlds: the scalability provided by NoSQL datastores such as HBase, and the concurrency and atomicity provided by transaction processing systems. Background.

Database 83

Database Datasets NoSQL Big Data 83

Rockset

MAY 17, 2022

We'll be publishing more posts in the series in the near future, so subscribe to our blog so you don't miss them! Limitations of NoSQL SQL supports complex queries because it is a very expressive, mature language. That changed when NoSQL databases such as key-value and document stores came on the scene.

SQL 52

SQL NoSQL Hadoop MongoDB 52

Rockset

AUGUST 29, 2019

In this blog, we examine DynamoDB reporting and analytics, which can be challenging given the lack of SQL and the difficulty running analytical queries in DynamoDB. In this blog post, we will walk through an example of using Tableau to visualize data in DynamoDB. This blog post evaluates a few approaches to bridge this gap.

NoSQL 40

NoSQL SQL Building Unstructured Data 40

Knowledge Hut

JULY 24, 2023

In this blog, we will talk about the future of database management. NoSQL Databases NoSQL databases are non-relational databases (that do not store data in rows or columns) more effective than conventional relational databases (databases that store information in a tabular format) in handling unstructured and semi-structured data.

Database 52

Database NoSQL Management Relational Database 52

DoorDash Engineering

JANUARY 30, 2024

In this blog pos,t we walk through DoorDash’s Cassandra optimization journey. Before we dive into those details, let’s briefly talk about the basics of Cassandra and its pros and cons as a distributed NoSQL database. If not carefully managed, this complexity can sometimes lead to unexpected behaviors or suboptimal performance.

NoSQL 84

NoSQL Database Systems Relational Database 84

Knowledge Hut

NOVEMBER 16, 2023

You can even read AWS blogs or avail online video courses. Reading the official AWS blogs will help you stay updated on the new products, features, concepts, and best practices. You need to be ready to dedicate considerable time and effort to learn and understand everything offered by AWS.

AWS 98

AWS Certification IT Amazon Web Services 98

Rockset

JANUARY 5, 2022

While it ensured data integrity, the distributed two-phase lock added a massive delay to SQL database writes — so massive that it inspired the rise of NoSQL databases optimized for fast data writes, such as HBase, Couchbase, and Cassandra. In truth, NoSQL databases also suffer from the same contention problem as traditional SQL databases.

Database 52

Database SQL NoSQL Raw Data 52

Knowledge Hut

JULY 26, 2023

In this blog, we will deep dive into database system applications in DBMS, and their components and look at a list of database applications. Database Software- Other NoSQL: NoSQL databases cover a variety of database software that differs from typical relational databases. What are Database Applications?

Database 52

Database NoSQL MongoDB Telecommunication 52

Confluent

AUGUST 19, 2019

This classic blog series provides a great end-to-end example of using Kafka Connect for those who are new to it. Feel free to read more about it in their blog post , check out the source code , and obtain the connector from the Confluent Hub. A configuration-based turnkey deployment framework for loading data into Apache Kafka.

Programming 15

Programming Kafka Database-centric MongoDB 15

ProjectPro

NOVEMBER 10, 2016

What are the blogs, books and courses you should take to become a Hadoop developer or administrator? What are the blogs, books and courses you should take to become a Hadoop developer or administrator? 5) 28% of Hadoopers possess NoSQL database skills. What are the essential skills to become a Hadoop developer or administrator?

Hadoop 52

Hadoop NoSQL Java Big Data 52

Rockset

JUNE 9, 2020

A common thread in many MongoDB and broader NoSQL discussions is the tight coupling between schema design and query patterns. The blog explains how to use single field indexes and compound indexes in the MongoDB context. Change Streams An Introduction to Change Streams The final recommendation comes from the MongoDB blog itself.

MongoDB 52

MongoDB NoSQL Database Kafka 52

Knowledge Hut

DECEMBER 26, 2023

Finally, apart from your academic degree and extra skills, you can also learn to channel your skills practically by taking on small projects such as creating an app, writing blogs, or even exploring data analysis to gather more information. NoSQL is a distributed data storage that is becoming increasingly popular.

Data Engineering 98

Data Engineering Data Engineer Engineering Hadoop 98

Rockset

DECEMBER 17, 2021

As a key-value NoSQL database, storing and retrieving individual records are its bread and butter. Note: This post was originally posted on the Omnata blog. For those unfamiliar, DynamoDB makes database scalability a breeze, but with some major caveats.

SQL 52

SQL NoSQL Database Design Metadata 52

Confluent

MAY 21, 2019

There are databases, document stores, data files, NoSQL and ETL processes involved. If you’re interested in reading about it more, Martin Kleppmann wrote a good blog post comparing schema evolution in different data formats. If you evaluate architectures by how easy they are to extend, then this architecture gets an A+.

Kafka 110

Kafka Insurance Architecture Database 110

Rockset

JULY 28, 2022

MongoDB has grown from a basic JSON key-value store to one of the most popular NoSQL database solutions in use today. Lewis Gavin has been a data engineer for five years and has also been blogging about skills within the Data community for four years on a personal blog and Medium.

MongoDB 52

MongoDB Kafka NoSQL Data Lake 52

Rockset

APRIL 29, 2019

In this blog post I compare options for real-time analytics on DynamoDB - Elasticsearch , Athena, and Spark - in terms of ease of setup, maintenance, query capability, latency. DynamoDB has been one of the most popular NoSQL databases in the cloud since its introduction in 2012.

NoSQL 52

NoSQL PostgreSQL AWS SQL 52

LinkedIn Engineering

JULY 19, 2023

In this blog post, we will discuss the guiding principles outlined for OpenHouse and the northstar UX when interfacing with OpenHouse tables. This service exposes a key-value interface that is designed to use a NoSQL DB for scale and cost optimization.

Big Data 78

Big Data Data Management Management Metadata 78

Workfall

NOVEMBER 29, 2022

In this blog, we will demonstrate how to connect to MongoDB using Mongoose and MongoDB Atlas in Node.js. In this blog, we will cover: What is MongoDB? It is classified as a NoSQL (Not only SQL) database because data in MongoDB is not stored and retrieved in the form of tables. appeared first on The Workfall Blog.

MongoDB 52

MongoDB Database NoSQL SQL 52

Databand.ai

AUGUST 30, 2023

Data storage platforms can include traditional relational databases, NoSQL databases, data lakes, or cloud-based storage services. A DataOps architecture must consider the performance, scalability, and cost implications of the chosen data storage platform.

Architecture 52

Architecture Data Ingestion Data Governance Data Cleanse 52