---
title: "Discussion on \"On our frozen MiniLM InvoiceHub run, κ(A,B) 0.82 but 30% label noise lifted apparent P@5 from 0.23 to 0.39\" | Hashnode"
description: "Discussion on \"On our frozen MiniLM InvoiceHub run, κ(A,B) 0.82 but 30% label noise lifted apparent P@5 from 0.23 to 0.39\". Author 116 InvoiceHub FAQ chunks × 15 queries, one frozen MiniLM top-5 / pool-20 run (seed 20260928, API $0). Dual-labeled the pool (Annotator-A vs B), then flip-noise 0/10/20/30% vs A. Retrieval list"
url: "https://hashnode.com/posts/on-our-frozen-minilm-invoicehub-run-a-b-0-82-but-30-label-noise-lifted-apparent-p-5-from-0-23-to-0-39/6abaae91ee601508cac44256"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [On our frozen MiniLM InvoiceHub run, κ(A,B) 0.82 but 30% label noise lifted apparent P@5 from 0.23 to 0.39](https://eworldlive.hashnode.dev/on-our-frozen-minilm-invoicehub-run-a-b-0-82-but-30-label-noise-lifted-apparent-p-5-from-0-23-to-0-39?utm_source=hashnode&utm_medium=feed)

Author 116 InvoiceHub FAQ chunks × 15 queries, one frozen MiniLM top-5 / pool-20 run (seed 20260928, API $0). Dual-labeled the pool (Annotator-A vs B), then flip-noise 0/10/20/30% vs A. Retrieval list

Sep 28 · 1 min read · eworldlive.hashnode.dev  
Read the article

-   [#rag](https://hashnode.com/tag/rag)
-   [#evaluation](https://hashnode.com/tag/evaluation)
-   [#label-noise](https://hashnode.com/tag/label-noise)
-   [#cohen-kappa](https://hashnode.com/tag/cohen-kappa)
-   [#precision](https://hashnode.com/tag/precision)

## Written by

[market](https://hashnode.com/@eworldlive)

@eworldlive

  
[View profile](https://hashnode.com/@eworldlive)

Denser boards for curious AI, tech, and weird-web stories

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
