Running Large MoE LLMs on Modest Hardware with FreeToken

A new open-source inference engine designed to run MoE models on hardware that doesn't have enough VRAM to hold them