--- title: "#localai articles | Hashnode" description: "Explore 18 articles tagged #localai on Hashnode. Tutorials, guides, and how-tos from the community." url: "https://hashnode.com/tag/localai" --- Tag # #localai 18 posts · 0 followers [ZyVOP](https://hashnode.com/@zyvop) · [Oct 7](https://hashnode.com/posts/strata-squeezes-a-125-billion-parameter-ai-onto-a-gaming-pc-heres-how/6ac631b6f800d6defa18afd9) ### [Strata Squeezes a 125-Billion-Parameter AI Onto a Gaming PC. Here's How.](https://blog.zyvop.com/strata-squeezes-a-125-billion-parameter-ai-onto-a-gaming-pc-heres-how?utm_source=hashnode&utm_medium=feed) A free, open-source project that runs a huge AI model on a regular gaming graphics card. No cloud, no monthly bill. Here is what it does and how it pulls it off. 13 min read · [blog.zyvop.com](https://blog.zyvop.com/strata-squeezes-a-125-billion-parameter-ai-onto-a-gaming-pc-heres-how?utm_source=hashnode&utm_medium=feed) [ZyVOP](https://hashnode.com/@zyvop) · [Sep 30](https://hashnode.com/posts/building-an-ai-that-never-stops-learning-on-8gb-of-vram/6abc783398502f910ec6d19a) ### [Building an AI That Never Stops Learning on 8GB of VRAM](https://blog.zyvop.com/building-an-ai-that-never-stops-learning-on-8gb-of-vram?utm_source=hashnode&utm_medium=feed) How mini-AGI trains a byte-level, mixture-of-experts model from scratch on a single 8GB GPU, and solves catastrophic forgetting with one learning-rate tweak. 8 min read · [blog.zyvop.com](https://blog.zyvop.com/building-an-ai-that-never-stops-learning-on-8gb-of-vram?utm_source=hashnode&utm_medium=feed) [ZyVOP](https://hashnode.com/@zyvop) · [Sep 25](https://hashnode.com/posts/can-a-2000-mini-pc-replace-your-ai-cloud-bill/6ab6a6c8488375a31a5b53f0) ### [Can a $2,000 Mini PC Replace Your AI Cloud Bill?](https://blog.zyvop.com/can-a-2000-mini-pc-replace-your-ai-cloud-bill?utm_source=hashnode&utm_medium=feed) AMD's Strix Halo chips can run 120B-class models locally. Here's what the benchmarks, power costs, and real-world agent workflows actually look like. 11 min read · [blog.zyvop.com](https://blog.zyvop.com/can-a-2000-mini-pc-replace-your-ai-cloud-bill?utm_source=hashnode&utm_medium=feed) [ZyVOP](https://hashnode.com/@zyvop) · [Sep 22](https://hashnode.com/posts/best-open-weight-llms-september-2026/6ab2597aea88bbe4a882c72b) ### [Best Open-Weight LLMs, September 2026](https://blog.zyvop.com/best-open-weight-llms-september-2026?utm_source=hashnode&utm_medium=feed) RAM needs, real license terms, API pricing, and benchmarks for GLM-5.3, Kimi K3, Qwen3.8, DeepSeek V4/V4.1, Tencent Hy4, and Gemma 4 - verified against primary sources. 30 min read · [blog.zyvop.com](https://blog.zyvop.com/best-open-weight-llms-september-2026?utm_source=hashnode&utm_medium=feed) [Dragos Roua](https://hashnode.com/@dragosroua) · [Sep 21](https://hashnode.com/posts/video-running-qwen-3-8-27b-ternary-bonsai-2-on-my-16gb-mac/6ab09e2f4cb6159b7d516836) ### [\[Video\] Running Qwen 3.8 27B Ternary Bonsai 2 on my 16GB Mac](https://dragosroua.hashnode.dev/video-running-qwen-3-8-27b-ternary-bonsai-2-on-my-16gb-mac?utm_source=hashnode&utm_medium=feed) This is a brief test of a heavily quantized version of Qwen 3.8 27B, fitting in 7GB on disk. Impressive, but not 98% of the original Qwen. 2 min read · [dragosroua.hashnode.dev](https://dragosroua.hashnode.dev/video-running-qwen-3-8-27b-ternary-bonsai-2-on-my-16gb-mac?utm_source=hashnode&utm_medium=feed) [2](https://hashnode.com/posts/video-running-qwen-3-8-27b-ternary-bonsai-2-on-my-16gb-mac/6ab09e2f4cb6159b7d516836) [Mihai\_LeanZero](https://hashnode.com/@mihaileanzero) · [Sep 20](https://hashnode.com/posts/qwen38-27b-atlassian-model-v05-now-with-gguf/6aafc473dad6da7a50b150f0) ### [Qwen3.8-27B Atlassian model v0.5, now with GGUF](https://leanzero.hashnode.dev/qwen38-27b-atlassian-model-v05-now-with-gguf?utm_source=hashnode&utm_medium=feed) Qwen3.8-27B tuned for Forge and Jira: v0.5 beat v0.4 on every gate. GGUF for llama.cpp and Ollama, Q8\_0 and Q6\_K, now published alongside MLX. 7 min read · [leanzero.hashnode.dev](https://leanzero.hashnode.dev/qwen38-27b-atlassian-model-v05-now-with-gguf?utm_source=hashnode&utm_medium=feed) [Max Quimby](https://hashnode.com/@computeleap) · [May 12](https://hashnode.com/posts/local-ai-just-became-the-default-gemma-4-omlx-on-m4/6a029db39b90b2f63b91ad56) ### [Local AI Just Became the Default: Gemma 4 + omlx on M4](https://computeleap.hashnode.dev/local-ai-just-became-the-default-gemma-4-omlx-on-m4?utm_source=hashnode&utm_medium=feed) Three independent signals — HN #1, jundot/omlx menu-bar app, Ollama official MLX migration — converged on Apple Silicon as the local-inference substrate. Here is what shipped and why it matters. 12 min read · [computeleap.hashnode.dev](https://computeleap.hashnode.dev/local-ai-just-became-the-default-gemma-4-omlx-on-m4?utm_source=hashnode&utm_medium=feed) [Artem Kunyk](https://hashnode.com/@infinitemonkey) · [Apr 5](https://hashnode.com/posts/reasoning-models-dont-fail-at-reasoning-the-protocol-layer-is-what-kills-local-agents/69d20064bcae9ca9ad754a58) ### [Reasoning Models Don't Fail at Reasoning: The Protocol Layer Is What Kills Local Agents](https://infinitemonkey.hashnode.dev/reasoning-models-dont-fail-at-reasoning-the-protocol-layer-is-what-kills-local-agents?utm_source=hashnode&utm_medium=feed) Reasoning Models Don't Fail at Reasoning: The Protocol Layer Is What Kills Local Agents April 5, 2026 · Artem The narrative around local LLMs stops at the model checkpoint. It never discusses what breaks between the model and the tool call. I ran mi... 6 min read · [infinitemonkey.hashnode.dev](https://infinitemonkey.hashnode.dev/reasoning-models-dont-fail-at-reasoning-the-protocol-layer-is-what-kills-local-agents?utm_source=hashnode&utm_medium=feed) [Lightning Developer](https://hashnode.com/@lightningdeveloper) · [Jan 30](https://hashnode.com/posts/the-state-of-local-ai-top-tools-and-models-for-2026/697c4ffd537eaa82162ffb7c) ### [The State of Local AI: Top Tools and Models for 2026](https://tech-odyssey.hashnode.dev/the-state-of-local-ai-top-tools-and-models-for-2026?utm_source=hashnode&utm_medium=feed) The landscape of artificial intelligence has shifted significantly over the last year. While cloud-based services dominated the early days of the AI boom, 2026 has become the year of local sovereignty. The ability to run sophisticated Large Language ... 4 min read · [tech-odyssey.hashnode.dev](https://tech-odyssey.hashnode.dev/the-state-of-local-ai-top-tools-and-models-for-2026?utm_source=hashnode&utm_medium=feed) [Taofiq Sulayman](https://hashnode.com/@CtrlAltCrash) · [Nov 18, 2025](https://hashnode.com/posts/running-llms-locally-with-ollama-a-practical-hands-on-guide/6944c0dc746823ae3b94de0b) ### [Running LLMs Locally with Ollama: A Practical, Hands-On Guide](https://ctrlaltcrash.hashnode.dev/running-llms-locally-with-ollama-a-practical-hands-on-guide?utm_source=hashnode&utm_medium=feed) For a long time, running Large Language Models felt like something reserved for big companies with deep pockets and cloud budgets. If you wanted to experiment seriously, you almost always ended up sending prompts to an external API and hoping for the... 5 min read · [ctrlaltcrash.hashnode.dev](https://ctrlaltcrash.hashnode.dev/running-llms-locally-with-ollama-a-practical-hands-on-guide?utm_source=hashnode&utm_medium=feed) [6](https://hashnode.com/posts/running-llms-locally-with-ollama-a-practical-hands-on-guide/6944c0dc746823ae3b94de0b)