SBShikhar Bhushaninblog.schmizz.net·Feb 18, 2024 · 7 min readDesigning serverless stream storageI have alluded to "hypothetical S2" (Stream Store), a true counterpart to S3 for data in motion. As I work on making S2 real, I wanted to share the design and how it shaped up. Vision Unlimited streams A pain point with most streaming data solutions ...00C
SBShikhar Bhushaninblog.schmizz.net·Nov 8, 2023 · 4 min readThe disaggregated write-ahead logThe traditional way replicated systems are architected is to physically co-locate the write-ahead log (WAL) on the nodes where the state is being maintained. Then a consensus protocol like Paxos or Raft is used to make sure the log on each replica ag...00