How much VRAM do you actually need to run Llama 3 or Gemma locally?
Every few days someone in a local LLM thread asks the same question: "will this run on my 3060?" And the answers are almost always vibes. "Should be fine." "Probably need to quantize." Nobody shows th
sathvickollu.hashnode.dev6 min read