Context Is All You Have: How LLM Attention Actually Works
Apr 1 · 5 min read · You've seen the marketing: "128k context window!" "1 million tokens!" But what does that actually mean for your use case? And why does your chatbot still forget what you said 20 messages ago? This is the first post in a series on LLM internals — no h...
Join discussion