Search posts, tags, users, and pages
Real llama.cpp numbers, why the KV cache is only 64 KiB per token, and which GGUF fits a 16, 24 or 32 GB GPU
donald991234
@donald991234
Markdown supported · ⌘↵ to post
No responses yet.