---
title: "Discussion on \"Local Inference: Running Models on Your Own Machine\" | Hashnode"
description: "Discussion on \"Local Inference: Running Models on Your Own Machine\". Ollama, llama.cpp, and what hardware actually gets you usable speed."
url: "https://hashnode.com/posts/local-inference/6afb0c6e57170ddd3bb9be08"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Local Inference: Running Models on Your Own Machine](https://internals-decoded.hashnode.dev/local-inference?utm_source=hashnode&utm_medium=feed)

Ollama, llama.cpp, and what hardware actually gets you usable speed.

3d ago · 16 min read · internals-decoded.hashnode.dev  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#localllm](https://hashnode.com/tag/localllm)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#llamacpp](https://hashnode.com/tag/llamacpp)

## Written by

[Internals Decoded](https://hashnode.com/@internalsdecoded)

@internalsdecoded · Toronto, Canada

  
[View profile](https://hashnode.com/@internalsdecoded)

AI Internals Explained Conversationally

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
