---
title: "Discussion on \"Local LLM's on WSL2\" | Hashnode"
description: "Discussion on \"Local LLM's on WSL2\". Below example demonstrates running locally Ollama and 𝐎𝐩𝐞𝐧-𝐖𝐞𝐛𝐔𝐈 𝐨𝐧 𝐚 𝐖𝐒𝐋2 containerized environment.  \n- The model Ollama is running in this example: 𝐐𝐰𝐞𝐧2.5-𝐂𝐨𝐝𝐞𝐫:0.5𝐛  \n- Presently it is on CPU as i have 𝐈𝐧𝐭𝐞𝐥 𝐈𝐫𝐢�..."
url: "https://hashnode.com/posts/local-llms-on-wsl2/6843ae69a49b720f769db13b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Local LLM's on WSL2](https://lostinopensrc.hashnode.dev/local-llms-on-wsl2?utm_source=hashnode&utm_medium=feed)

Below example demonstrates running locally Ollama and 𝐎𝐩𝐞𝐧-𝐖𝐞𝐛𝐔𝐈 𝐨𝐧 𝐚 𝐖𝐒𝐋2 containerized environment. - The model Ollama is running in this example: 𝐐𝐰𝐞𝐧2.5-𝐂𝐨𝐝𝐞𝐫:0.5𝐛 - Presently it is on CPU as i have 𝐈𝐧𝐭𝐞𝐥 𝐈𝐫𝐢�...

Jun 7, 2025 · 1 min read · lostinopensrc.hashnode.dev  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#wsl2](https://hashnode.com/tag/wsl2)
-   [#podman](https://hashnode.com/tag/podman)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#open-webui](https://hashnode.com/tag/open-webui)

## Written by

[Gaurav](https://hashnode.com/@gp21)

@gp21

  
[View profile](https://hashnode.com/@gp21)

Cloud DevOps Engineer

## Responses 1

Markdown supported · ⌘↵ to post

[Lamri Abdellah Ramdane](https://hashnode.com/@larmiabdellah213)

[Sep 15, 2025](https://hashnode.com/posts/local-llms-on-wsl2/6843ae69a49b720f769db13b/comment/68c7851240c10052aa41ef64)

This is a great topic! Getting local LLMs running on WSL2 can be a bit tricky, but it's so powerful. For a complete local dev environment that makes it easy to set up and manage these kinds of tools, I'd highly recommend checking out ServBay.

[Gaurav](https://hashnode.com/@gp21)

[Sep 18, 2025](https://hashnode.com/posts/local-llms-on-wsl2/6843ae69a49b720f769db13b/comment/68c7851240c10052aa41ef64#reply-68cc072bcda2c1ec698078db)

Thanks will surely check out !
