More Chunks Found the Right Document 90% of the Time. The Model Used It Less. RAG Interview Questions, With the Numbers

We gave one small model 20 questions and changed a single setting: how many chunks go into the prompt. With 5 chunks, the right document was in the prompt for 55% of the questions. With 20 chunks, it