The "Who approved Policy X" example is a good one because it shows retrieval only helps if the answer is actually grounded in what came back, not just appended to the prompt. In practice most RAG failures I see are upstream of the model: wrong chunk retrieved, or the right chunk retrieved but ranked too low to make the context window. A follow-up on how you measure whether an answer was faithful to the retrieved passages would round this out well.
Kartik N V J K
The "Who approved Policy X" example is a good one because it shows retrieval only helps if the answer is actually grounded in what came back, not just appended to the prompt. In practice most RAG failures I see are upstream of the model: wrong chunk retrieved, or the right chunk retrieved but ranked too low to make the context window. A follow-up on how you measure whether an answer was faithful to the retrieved passages would round this out well.