Context Length: Why the Model Forgets, and What It Costs You

People are often surprised the first time a chatbot forgets what they said three messages ago. It feels like a bug. It isn't. Understanding why comes down to one idea that explains a huge amount of ho