V2: Multi-Head Latent Attention (MLA)

While standard attention mechanisms have served us well, if we want to tackle the major bottlenecks in scaling large language models, we have to look closely at the KV cache. The conceptual explanatio