What quantisation actually trades off and when that trade-off is yours to make

This is for people trying to run AI models locally on a personal machine. Say you want to run Llama locally on a MacBook Air, you visit Hugging Face and see a number printed on every model card that a