Sajan Rajbhandari

Will it Fit? What Happens When You Run an Open Weight Model?

TL;DR: Fitting a model in a box depends more than a download size. This article explains about the concepts like open weights, quantization, KV cache, MoE architecture, etc. which can determine if the