Blog Bytes Data Storage 
Pinterest Engineering
NOVEMBER 22, 2023
In the first blog, we will share a short summary on the GokuS and GokuL architecture, data format for Goku Long Term, and how we improved the bootstrap time for our storage and serving components. Goku Long Term Storage Architecture Summary and Challenges Figure 9: Flow of data from GokuS to GokuL.
Netflix Tech
SEPTEMBER 18, 2024
The Key-Value Service The KV data abstraction service was introduced to solve the persistent challenges we faced with data access patterns in our distributed databases. The first level is a hashed string ID (the primary key), and the second level is a sorted map of a key-value pair of bytes.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Snowflake
APRIL 18, 2024
This blog post explores how Snowflake can help with this challenge. Legacy SIEM cost factors to keep in mind Data ingestion: Traditional SIEMs often impose limits to data ingestion and data retention. Now there are a few ways to ingest data into Snowflake. But what if security teams didn’t have to make tradeoffs?
ProjectPro
JANUARY 24, 2023
Tired of relentlessly searching for the most effective and powerful data warehousing solutions on the internet? This blog is your comprehensive guide to Google BigQuery, its architecture, and a beginner-friendly tutorial on how to use Google BigQuery for your data warehousing activities. Search no more! Did you know ?
Databand.ai
JUNE 8, 2023
Key components of an observability pipeline include: Data collection: Acquiring relevant information from various stages of your data pipelines using monitoring agents or instrumentation libraries. Data storage: Keeping collected metrics and logs in a scalable database or time-series platform.
Scott Logic
APRIL 5, 2024
Introduction This series of blog posts discusses the methods of estimating carbon emissions of end-user devices. After intending to write a single blog post, the research journey prompted me to reconsider how to present this to an audience. js is a javascript library that returns an estimated CO2e value for a web page.
Pinterest Engineering
SEPTEMBER 9, 2024
This three part blog post series covers the efficiency improvements (view parts 1 and parts 2 ), and this final part will cover the reduction of the overall cost of Goku and Pinterest. GokuS consumes from this second Kafka topic and backs up the data intoS3. Goku created multiple folly::IOBufs of capacity 1 MiB to store finalized data.
Expert insights. Personalized for you.
111 
Let's personalize your content