REFRAG: Meta's Trick to Make RAG Blazing Fast - and Still Exact

How “Compress • Sense • Expand” lets LLMs handle huge knowledge bases without drowning in tokens. Retrieval-Augmented Generation (RAG) is the backbone of knowledge-grounded LLM apps — but it’s painfully slow once you start feeding the model thousands...