---
title: "Discussion on \"How to Run AI Models Offline on Linux\" | Hashnode"
description: "Discussion on \"How to Run AI Models Offline on Linux\". Part 1: How I Set Up My Local LLM (Large Language Model)"
url: "https://hashnode.com/posts/how-to-run-ai-models-offline-on-linux/6a2422a44a5fa0d7d7deef8f"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [How to Run AI Models Offline on Linux](https://haribuilds.hashnode.dev/how-to-run-ai-models-offline-on-linux?utm_source=hashnode&utm_medium=feed)

Part 1: How I Set Up My Local LLM (Large Language Model)

Jun 6 · 4 min read · haribuilds.hashnode.dev  
Updated Jun 14  
Read the article

-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#linux](https://hashnode.com/tag/linux)
-   [#llm](https://hashnode.com/tag/llm)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#popos](https://hashnode.com/tag/popos)
-   [#devops](https://hashnode.com/tag/devops)
-   [#local-llm](https://hashnode.com/tag/local-llm)

## Written by

[Hari Marthala](https://hashnode.com/@hari-marthala)

@hari-marthala · Australia

  
[View profile](https://hashnode.com/@hari-marthala)

Building my AI lab environment, exploring new tools, and sharing about my hands-on learning and experiences.

I am a tech enthusiast and love getting my hands dirty with new tools and ideas. I work as an IT Support engineer and am now starting from the fundamentals of AI, working my way through LLMs, and eventually diving into things like n8n workflows or anything else I pick up along the way. I write here to share my work, learnings and experiences, so it helps anyone who are just dipping their toes into this vast ocean. And honestly, writing it all down helps me as much!

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
