Aaivrarinaivrar.hashnode.dev·9h ago · 7 min readRunning a local AI agent on Windows with LM Studio, no Docker or admin rightsI wanted an AI agent on Windows that could use tools (files, a shell, web search, a browser) and talk to a model running on my own GPU. Most agent frameworks expect Linux, Docker, or a system Python y00
Aaivrarinaivrar.hashnode.dev·9h ago · 6 min readRunning vLLM natively on WindowsvLLM officially supports Linux only. On Windows the usual answer is WSL or Docker. I wanted it running natively, with real CUDA kernels and an OpenAI-compatible server, and no Linux layer. So I mainta00
