How much VRAM do you actually need to run Llama 3 or Gemma locally?

6h ago · 6 min read · Every few days someone in a local LLM thread asks the same question: "will this run on my 3060?" And the answers are almost always vibes. "Should be fine." "Probably need to quantize." Nobody shows th