---
title: "Discussion on \"Running Local LLMs on a Potato: AI on a 6 GB GPU\" | Hashnode"
description: "Discussion on \"Running Local LLMs on a Potato: AI on a 6 GB GPU\". Everyone assumes AI needs a monster GPU. Most of mine runs on 6 GB, at home, for free."
url: "https://hashnode.com/posts/running-local-llms-on-a-potato-ai-on-a-6-gb-gpu/6a4c7d62c41eae608d9cc499"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Running Local LLMs on a Potato: AI on a 6 GB GPU](https://glassboxtrader.hashnode.dev/running-local-llms-on-a-potato-ai-on-a-6-gb-gpu?utm_source=hashnode&utm_medium=feed)

Everyone assumes AI needs a monster GPU. Most of mine runs on 6 GB, at home, for free.

Jul 7 · 3 min read · glassboxtrader.hashnode.dev  
Read the article

-   [#build-in-public](https://hashnode.com/tag/build-in-public)
-   [#local-first](https://hashnode.com/tag/local-first)
-   [#ai](https://hashnode.com/tag/ai)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#llm](https://hashnode.com/tag/llm)

## Written by

[Glassboxtrader](https://hashnode.com/@glassboxtrader)

@glassboxtrader · Zurich, Switzerland

  
[View profile](https://hashnode.com/@glassboxtrader)

No black boxes, no hype — an honest trading bot, built in public.

Building an honest, explainable trading bot in public — one PC, a 6 GB GPU, a NAS. No black boxes, no hype.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
