---
title: "Discussion on \"I Couldn't Find a Local LLM Tool Fast Enough, So I Built My Own Called Squish\" | Hashnode"
description: "Discussion on \"I Couldn't Find a Local LLM Tool Fast Enough, So I Built My Own Called Squish\". I Couldn't Find a Local LLM Tool Fast Enough, So I Built My Own Called Squish"
url: "https://hashnode.com/posts/i-couldn-t-find-a-local-llm-tool-fast-enough-so-i-built-my-own-called-squish/6a55067b8fed274bebb90d5b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [I Couldn't Find a Local LLM Tool Fast Enough, So I Built My Own Called Squish](https://konjo.hashnode.dev/i-couldn-t-find-a-local-llm-tool-fast-enough-so-i-built-my-own-called-squish?utm_source=hashnode&utm_medium=feed)

I Couldn't Find a Local LLM Tool Fast Enough, So I Built My Own Called Squish

Jul 13 · 21 min read · konjo.hashnode.dev  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#ai](https://hashnode.com/tag/ai)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#inference](https://hashnode.com/tag/inference)
-   [#local-llm](https://hashnode.com/tag/local-llm)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#qwen](https://hashnode.com/tag/qwen)
-   [#mlx](https://hashnode.com/tag/mlx)
-   [#apple](https://hashnode.com/tag/apple)
-   [#promptengineering](https://hashnode.com/tag/promptengineering)
-   [#opensource](https://hashnode.com/tag/opensource)
-   [#open-source](https://hashnode.com/tag/open-source)
-   [#python](https://hashnode.com/tag/python)
-   [#macos](https://hashnode.com/tag/macos)
-   [#rust](https://hashnode.com/tag/rust)
-   [#quantization](https://hashnode.com/tag/quantization)
-   [#benchmark](https://hashnode.com/tag/benchmark)

## Written by

[wesley scholl](https://hashnode.com/@wesmsl)

@wesmsl

  
[View profile](https://hashnode.com/@wesmsl)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
