
One question took me through Edge0: if the 35B model only needs 2.9 GB of RAM, what does the machine actually need? The answer is a disk budget, a cache budget and a context budget, and none of them i
Developer with founder delusions
Technical Lead | Senior Full Stack Engineer | React, Node.js, TypeScript | AI-Driven Development
Markdown supported · ⌘↵ to post
No responses yet.