Essays and notes worth sharing.

PostSummary
Designing a scalable fanout serviceDesigning a service that ingests events and broadcasts messages to millions of recipients — covering recipient lookup, delivery, and the tradeoffs at scale.
Building NSE tick collector with Zerodha Kite ConnectHow to collect real-time tick data for all ~9,000 NSE instruments, store it cheaply in Parquet, and query it after market close using DuckDB.
Scaling Acoustic Scene Simulation PipelineHow a simulation pipeline was redesigned to scale from ~1M to 10M scenes — covering compute distribution, storage layout, metadata coordination, and failure recovery.
Building Gokey A Key-Value Store on RaftA toy project to learn about raft and replication.