LLM Quantization: The Closest Weights Can Make Worse Outputs

0.897974 became 0.002041 when I let two quantized weights choose opposite directions. The weights themselves got slightly less accurate. I ran this tiny calculation today because I want quantization r