---
title: "Discussion on \"My RAG evals said 100%. The answers were still wrong.\" | Hashnode"
description: "Discussion on \"My RAG evals said 100%. The answers were still wrong.\". What a 30-question test set caught in my notes app: a reranker reading the wrong part of a note, and a phone number reaching the model."
url: "https://hashnode.com/posts/my-rag-evals-said-100-the-answers-were-still-wrong/6af9371818f3070216abb7fe"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [My RAG evals said 100%. The answers were still wrong.](https://trialswithtech.hashnode.dev/my-rag-evals-said-100-the-answers-were-still-wrong?utm_source=hashnode&utm_medium=feed)

What a 30-question test set caught in my notes app: a reranker reading the wrong part of a note, and a phone number reaching the model.

48m ago · 11 min read · trialswithtech.hashnode.dev  
Read the article

-   [#rag](https://hashnode.com/tag/rag)
-   [#llm](https://hashnode.com/tag/llm)
-   [#testing](https://hashnode.com/tag/testing)
-   [#python](https://hashnode.com/tag/python)
-   [#ai](https://hashnode.com/tag/ai)

## Written by

[Abhishek Panja](https://hashnode.com/@abhishekpanja554)

@abhishekpanja554 · Bengaluru, India

  
[View profile](https://hashnode.com/@abhishekpanja554)

A fellow curious person.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.