Running ollama on Proxmox VM
I am using a Gigabyte GTX1060 G1 Gaming 3GB GDDR5 as my GPU to run ollama models. To do that, I first need to do a GPU passthrough to my virtual machine. Reference for this tutorial
proxmox host setup for GPU passthrough
Verify CPU supports hardware...
blog.wongandre.com4 min read