Search posts, tags, users, and pages
Every time a new open model drops, the same question comes back: will it fit on my GPU? Here is how to think about it, with concrete numbers. 1. Memory = weights + KV cache + a little buffer The GGUF
sheephess9527
@sheephess9527
Markdown supported · ⌘↵ to post
No responses yet.