A 35B Model, 6GB of VRAM, and a Lot of Systems Programming

Introduction Hi guys, I've been working with SLMs recently and I wanted to share some thoughts and experiences from a rabbit hole I accidentally fell into. For context, I'm really into systems program