Distributed, high-performance blob storage on SQLiteImage: zerodha.tech
Developing

Distributed, high-performance blob storage on SQLite

Heat 66 · #10 in Tech · Rising3 reports · 3 sources · First reported Nov 19 · Updated Nov 20

The story

Zerodha has described Blobasaur, an open-source blob storage server it built in Rust on top of SQLite, which it runs in production in place of SSDB. The server shards data across SQLite databases and speaks the Redis protocol. According to Zerodha, a 16-shard setup reaches 25,324 HSET operations per second at a p99 latency of 8.3 ms with 64 KiB payloads, and its production three-node cluster — 4 vCPUs and 8 GB of memory per node — holds p99 latency around 2 ms across a trading session.
Latest development
production 3-node cluster (4 vCPU, 8 GB) holds p99 ~2 ms across a trading session. This round's search found no independent second source for this post (only generic distributed-SQLite pieces), so cross stays 50. Score 72.0 (rank 95, discussion 60, cross 50).

The angle

Zerodha replaced its blob store with SQLite shards and got 25k writes/sec - when boring tech beats distributed systemsSuggested format: Short video · for Backend engineers, infra and database watchers

Heat

Now 66 · Peak 66 · 62 recorded checks since Nov 20
Full ranking →