Jan 7 · 4 min read · You’ve built a RAG pipeline. You’ve tuned your embeddings, optimized your chunk sizes, and maybe even added a re-ranker. For simple questions, it works perfectly. But then, I asked my system a question that required connecting two dots hidden at oppo...
Join discussionDec 24, 2025 · 3 min read · The Problem: Context is a Graveyard In software engineering, having Git means we don’t just store code — we preserve its history. We know which decisions are current and which ones are legacy. Now in LLMs we use transformers, a neural network archite...
Join discussion
Aug 15, 2025 · 6 min read · Have you ever wondered why sometimes an AI chatbot seems to "forget" what you discussed earlier in a long conversation? The answer lies in something called a context window essentially the AI's working memory. Let's dive deep into this fundamental co...
Join discussion
Apr 1, 2025 · 13 min read · Introduction Large Language Models (LLMs) have rapidly expanded their context lengths(the amount of text they can process in one prompt). Early GPT-3 variants were limited to ~2K-4K tokens, but recent models like OpenAI’s GPT-4, Anthropic’s Claude, a...
Join discussion