A 397-billion parameter model just ran on a MacBook. Not a cloud instance. Not an API call. A MacBook Pro M3 Max with 48GB of RAM. danveloper/flash-moe is a pure C/Metal inference engine that runs Qwen3.5-397B-A17B - a 397B Mixture-of-Experts model -...
Markdown supported · ⌘↵ to post
No responses yet.