---
title: "Discussion on \"Your Local LLM Is Slow Because of Five Config Flags\" | Hashnode"
description: "Discussion on \"Your Local LLM Is Slow Because of Five Config Flags\". KV cache, context size, and batch size control more of the performance budget than most people realize"
url: "https://hashnode.com/posts/your-local-llm-is-slow-because-of-five-config-flags/69e00519f95c47e87f56f05b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Your Local LLM Is Slow Because of Five Config Flags](https://omniforge.online/blog/your-local-llm-is-slow-because-of-five-config-flags?utm_source=hashnode&utm_medium=feed)

KV cache, context size, and batch size control more of the performance budget than most people realize

Apr 15 · 8 min read · omniforge.online  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#llamacpp](https://hashnode.com/tag/llamacpp)
-   [#llama-cpp](https://hashnode.com/tag/llama-cpp)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#local-ai](https://hashnode.com/tag/local-ai)
-   [#local-llm](https://hashnode.com/tag/local-llm)
-   [#local-inference](https://hashnode.com/tag/local-inference)
-   [#apple-silicon](https://hashnode.com/tag/apple-silicon)
-   [#llm-performance-optimization](https://hashnode.com/tag/llm-performance-optimization)
-   [#kv-cache](https://hashnode.com/tag/kv-cache)
-   [#flash-attention](https://hashnode.com/tag/flash-attention)
-   [#batch-size-optimization](https://hashnode.com/tag/batch-size-optimization)

## Written by

[Vlad Butacu](https://hashnode.com/@vlad-omniforge)

@vlad-omniforge · Amsterdam, Netherlands

  
[View profile](https://hashnode.com/@vlad-omniforge)

CTO at OmniForge

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
