Running Local LLMs on a Potato: AI on a 6 GB GPU
Part 5 of an honest build-in-public series — the wins, the dead ends, and what actually works. Previously: My Entire Setup: One PC, a 6 GB GPU, and a NAS
The assumption is that "AI" means a giant GPU
glassboxtrader.hashnode.dev3 min read