Qwen3.8 27B VRAM, measured: Q4_K_M uses 19.95 GiB at 32K contextReal llama.cpp numbers, why the KV cache is only 64 KiB per token, and which GGUF fits a 16, 24 or 32 GB GPU5 min read·modelvram.hashnode.devOct 12
How much extra VRAM speculative decoding needs in llama.cpp (MTP, DFlash, draft models)Speculative decoding makes local LLMs noticeably faster, but it is not free: the draft (an MTP head, a DFlash drafter or a small draft model) needs its own VRAM. People regularly run out of memory aft4 min read·modelvram.hashnode.dev24KMSep 29