How to Serve Mistral Medium 3.5 128B Without Running Out of GPU Memory

So you saw Mistral dropped their new open-weight 128B parameter model and thought "I should run this locally." You pulled the weights, fired up your inference server, and immediately got slapped with an OOM error. Yeah. Been there. Serving large dens...