Internals: How Kafka 3.8's Log Storage Works for 1PB of Event Data with ZooKeeper 3.8 and KRaft 3.8

When a global ad-tech firm scaled their event pipeline to 1.2PB of Kafka 3.8 stored data last quarter, they hit a wall: ZooKeeper 3.8 coordination added 400ms of p99 latency to log segment roll operations, while KRaft 3.8 reduced that to 12ms—but onl...