Honey I shrunk the AI : Quantizing LLM's for Edge Hardware

Oct 26, 2024 · 9 min read · One could argue that humanity’s rise to power on this planet came from its ability to walk on two legs, or the ability to throw sharp rocks at food, or even the ability to touch, hear and see at a deeper level than any other animal. However, one abil...