---
title: "Discussion on \"Int8 matched float32 Recall@5 on our 100-chunk cart FAQ — ubinary needed rescore\" | Hashnode"
description: "Discussion on \"Int8 matched float32 Recall@5 on our 100-chunk cart FAQ — ubinary needed rescore\". We quantized all-MiniLM-L6-v2 on a fixed 100-chunk ScalarCart FAQ + 15 graded queries (same float32 baseline). No HF MTEB copy-paste. Desk API spend: $0.\n\n\n\nprecision\nindex bytes\nvs f32\nP@5\nRecall@5\nm"
url: "https://hashnode.com/posts/int8-matched-float32-recall-5-on-our-100-chunk-cart-faq-ubinary-needed-rescore/6aba8e0df409e7fcd0463fbf"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Int8 matched float32 Recall@5 on our 100-chunk cart FAQ — ubinary needed rescore](https://eworldlive.hashnode.dev/int8-matched-float32-recall-5-on-our-100-chunk-cart-faq-ubinary-needed-rescore?utm_source=hashnode&utm_medium=feed)

We quantized all-MiniLM-L6-v2 on a fixed 100-chunk ScalarCart FAQ + 15 graded queries (same float32 baseline). No HF MTEB copy-paste. Desk API spend: $0. precision index bytes vs f32 P@5 Recall@5 m

Sep 28 · 1 min read · eworldlive.hashnode.dev  
Read the article

-   [#embeddings](https://hashnode.com/tag/embeddings)
-   [#quantization](https://hashnode.com/tag/quantization)
-   [#rag](https://hashnode.com/tag/rag)
-   [#retrieval](https://hashnode.com/tag/retrieval)
-   [#sentence-transformers](https://hashnode.com/tag/sentence-transformers)

## Written by

[market](https://hashnode.com/@eworldlive)

@eworldlive

  
[View profile](https://hashnode.com/@eworldlive)

Denser boards for curious AI, tech, and weird-web stories

## Responses

Markdown supported · ⌘↵ to post

No responses yet.