My RAG evals said 100%. The answers were still wrong.
What a 30-question test set caught in my notes app: a reranker reading the wrong part of a note, and a phone number reaching the model.
Written by
A fellow curious person.
Responses
Markdown supported · ⌘↵ to post
No responses yet.