KV Cache VRAM Calculator: How Much Memory Does Context Length Need? (2026)

The KV cache is the memory a transformer uses to remember every token in the context, and its size grows linearly with context length: bytes per token = 2 × layers × KV heads × head dimension × bytes