Edge0 streams MoE experts off SSD to fit 35B in 3 GB

One question took me through Edge0: if the 35B model only needs 2.9 GB of RAM, what does the machine actually need? The answer is a disk budget, a cache budget and a context budget, and none of them i