INT8 Quantization the Second Time Around
I did per-row scalar quantization once already, on Lattice — my vector database — compressing stored vectors down to int8 so the index takes a quarter of the memory. This time it's the same technique,
amankarki.hashnode.dev6 min read