---
title: "Discussion on \"What I learned building a RAG notes app (and the evals I skipped)\" | Hashnode"
description: "Discussion on \"What I learned building a RAG notes app (and the evals I skipped)\". Embeddings, vector search, reranking, and getting Flutter, Spring Boot and Python to talk to each other"
url: "https://hashnode.com/posts/what-i-learned-building-a-rag-notes-app-and-the-evals-i-skipped/6aed9cf3af39498fe75b6f87"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [What I learned building a RAG notes app (and the evals I skipped)](https://trialswithtech.hashnode.dev/what-i-learned-building-a-rag-notes-app-and-the-evals-i-skipped?utm_source=hashnode&utm_medium=feed)

Embeddings, vector search, reranking, and getting Flutter, Spring Boot and Python to talk to each other

Nov 6 · 13 min read · trialswithtech.hashnode.dev  
Updated 38m ago  
Read the article

-   [#rag](https://hashnode.com/tag/rag)
-   [#python](https://hashnode.com/tag/python)
-   [#postgresql](https://hashnode.com/tag/postgresql)
-   [#springboot](https://hashnode.com/tag/springboot)
-   [#ai](https://hashnode.com/tag/ai)

## Written by

[Abhishek Panja](https://hashnode.com/@abhishekpanja554)

@abhishekpanja554 · Bengaluru, India

  
[View profile](https://hashnode.com/@abhishekpanja554)

A fellow curious person.

## Responses 1

Markdown supported · ⌘↵ to post

[Ahmet Özel](https://hashnode.com/@ahmetozel)

[Nov 7](https://hashnode.com/posts/what-i-learned-building-a-rag-notes-app-and-the-evals-i-skipped/6aed9cf3af39498fe75b6f87/comment/6aef42d1b8079c2fa10e274d)

The keyword-only fallback to a note's first piece can lose a correct candidate even after retrieval succeeded. If the matching term and answer sit near the end of a long note, the reranker sees its unrelated introduction and can discard the very note that keyword search found.

I would preserve the keyword match location and map it to the corresponding piece before reranking. One fixture with the answer only in the final piece would distinguish this from the separate top-20 candidate problem you described, and stage-level results would show whether the note disappeared before or during reranking.