--- title: "#gguf articles | Hashnode" description: "Explore 14 articles tagged #gguf on Hashnode. Tutorials, guides, and how-tos from the community." url: "https://hashnode.com/tag/gguf" --- Tag # #gguf 14 posts · 0 followers [Haithem Slimi](https://hashnode.com/@haithem-slimi) · [Oct 9](https://hashnode.com/posts/running-llms-locally-how-to-pick-the-right-tool-and-model-for-your-machine/6ac87f7024f10ae309d2d4d6) ### [Running LLMs Locally: How to Pick the Right Tool and Model for Your Machine](https://nightthoughts.me/running-llms-locally-how-to-pick-the-right-tool-and-model-for-your-machine?utm_source=hashnode&utm_medium=feed) A practical guide for getting your first local model running — and choosing one that actually fits the hardware you already own. 17 min read · [nightthoughts.me](https://nightthoughts.me/running-llms-locally-how-to-pick-the-right-tool-and-model-for-your-machine?utm_source=hashnode&utm_medium=feed) [1](https://hashnode.com/posts/running-llms-locally-how-to-pick-the-right-tool-and-model-for-your-machine/6ac87f7024f10ae309d2d4d6) [mamonu](https://hashnode.com/@mamonu) · [Sep 12](https://hashnode.com/posts/what-fits-and-what-works/6aa4a07d508f0b7ea408dce7) ### [What Fits and What Works](https://mamonu.hashnode.dev/what-fits-and-what-works?utm_source=hashnode&utm_medium=feed) gpt-oss-20b is my current go-to locally hosted LLM. I explain why 14 min read · [mamonu.hashnode.dev](https://mamonu.hashnode.dev/what-fits-and-what-works?utm_source=hashnode&utm_medium=feed) [Brian King](https://hashnode.com/@SoloDevNZ) · [Jul 9](https://hashnode.com/posts/installing-vllm-onto-evo-x2/6a4ffa046d09cc7944c28486) ### [Installing vLLM onto EVO-X2.](https://solodev.app/installing-vllm-onto-evo-x2?utm_source=hashnode&utm_medium=feed) Or: Adding Tool Support for Local LLMs. 12 min read · [solodev.app](https://solodev.app/installing-vllm-onto-evo-x2?utm_source=hashnode&utm_medium=feed) [Tanisha Soni](https://hashnode.com/@tanisha-soni) · [Jul 5](https://hashnode.com/posts/custom-langchain-chat-model-local-llm/6a4a28818251985fc678d4c8) ### [I Taught My Local Model to Speak LangChain](https://tanisha-soni.hashnode.dev/custom-langchain-chat-model-local-llm?utm_source=hashnode&utm_medium=feed) How to extend BaseChatModel, implement tool calling, parse JSON responses, and run self hosted GGUF model with LangChain no other API required. 9 min read · [tanisha-soni.hashnode.dev](https://tanisha-soni.hashnode.dev/custom-langchain-chat-model-local-llm?utm_source=hashnode&utm_medium=feed) [Vũ Nhật Lâm](https://hashnode.com/@kami61) · [May 30](https://hashnode.com/posts/bleeding-llama-cve-2026-7482-when-300-000-ai-servers-become-targets/6a1aa8632365cdee7fcc40fe) ### [Bleeding Llama — CVE-2026-7482: When 300,000 AI Servers Become Targets](https://blog.fiscybersec.com/bleeding-llama-cve-2026-7482-when-300-000-ai-servers-become-targets?utm_source=hashnode&utm_medium=feed) Risk Summary CVE-2026-7482 (CVSS 9.1 — Critical) allows an attacker to read heap memory directly from a running Ollama process without any credentials. Using just three API calls, all sensitive data c 11 min read · [blog.fiscybersec.com](https://blog.fiscybersec.com/bleeding-llama-cve-2026-7482-when-300-000-ai-servers-become-targets?utm_source=hashnode&utm_medium=feed) [Amegilla](https://hashnode.com/@amegillaAI) · [Dec 27, 2025](https://hashnode.com/posts/creating-a-gguf-registry-for-local-models-on-my-dgx-spark/695002236577a4462621e3dc) ### [Creating a GGUF Registry for local models on my DGX Spark](https://sparktastic.hashnode.dev/creating-a-gguf-registry-for-local-models-on-my-dgx-spark?utm_source=hashnode&utm_medium=feed) Prior to acquiring a DGX Spark, my experience running local LLMs was limited to basic experimentation with Ollama. So when I got my new toy I went a bit crazy downloading lots of different models. And then ended up with a page of notes containing a l... 5 min read · [sparktastic.hashnode.dev](https://sparktastic.hashnode.dev/creating-a-gguf-registry-for-local-models-on-my-dgx-spark?utm_source=hashnode&utm_medium=feed) [创联娱乐开户客服](https://hashnode.com/@xmm) · [May 25, 2025](https://hashnode.com/posts/5bya5oi35bcx6ycb5b2p6yer55qe5y2b5asn572r5b2p5bmz5yw5o6o6i2qcg/6832d95babcae2897b966685) ### [开户就送彩金的十大网彩平台推荐](https://hngj.hashnode.dev/5bya5oi35bcx6ycb5b2p6yer55qe5y2b5asn572r5b2p5bmz5yw5o6o6i2qcg?utm_source=hashnode&utm_medium=feed) 赌博靠谱网络平台娱乐游戏网址：cl033.com 游戏开户经理飞机：【@CL20255】正规实体平台-创联娱乐实体网赌平台-创联游戏联盟实体网赌平台推荐-十大亚洲博彩娱乐-亚洲赌博平台线上开户-线上赌博/APP-十大实体赌博平台推荐-实体网络赌博平台由库拉索岛政府授权，可以从事博彩相关活动。正规博彩十大网站排名平台成立于少年，平台专注于快速发展的国内市场，现在它为全世界的玩家和职业玩家提供服务。毫无疑问，正规博彩十大网站排名平台其实是欧洲全球最受青睐的欢迎正规的知名在线博彩公司。玩家的积极反馈、... 1 min read · [hngj.hashnode.dev](https://hngj.hashnode.dev/5bya5oi35bcx6ycb5b2p6yer55qe5y2b5asn572r5b2p5bmz5yw5o6o6i2qcg?utm_source=hashnode&utm_medium=feed) [华纳国际开户客服](https://hashnode.com/@hngjkhtj) · [May 21, 2025](https://hashnode.com/posts/572r6lwm5a6e5l2t5bmz5yw5asn6ke5qu772c5y2b5asn5pya5l2z5bmz5yw5p2d5aib5o6o6i2qcgo/682d82bc31a27dd5a6b08bda) ### [网赌实体平台大评比｜十大最佳平台权威推荐](https://clylkhtj.hashnode.dev/572r6lwm5a6e5l2t5bmz5yw5asn6ke5qu772c5y2b5asn5pya5l2z5bmz5yw5p2d5aib5o6o6i2qcgo?utm_source=hashnode&utm_medium=feed) 东南亚线上网赌平台 合法网上赌场,中国网上合法赌场,最好的网上赌场 网赌十大快3平台 — 十大网赌平台推荐 网赌最好最大平台-十大最好的网赌平台 十大靠谱网赌平台- 网上赌搏网站十大排行 全球最大网赌正规平台: 十大赌博靠谱网络平台 娱乐游戏网址网站 ：CL033.com 游戏开户【纸飞机：@CL20255】正规实体平台 ，东南亚实体大赌场的现场实况连线平台，连续多年占据全球线上娱乐顶级品牌榜！是您在线博彩娱乐的首选平台！ 现场百家乐、现场龙虎、VIP百家乐、VIP龙虎，牛牛、炸金花、大小、单双... 1 min read · [clylkhtj.hashnode.dev](https://clylkhtj.hashnode.dev/572r6lwm5a6e5l2t5bmz5yw5asn6ke5qu772c5y2b5asn5pya5l2z5bmz5yw5p2d5aib5o6o6i2qcgo?utm_source=hashnode&utm_medium=feed) [Robert Collins](https://hashnode.com/@robbiemu) · [Oct 28, 2024](https://hashnode.com/posts/on-kl-divergence-and-context-size-optimization-in-gguf-quantization/671f07e3792e8844791ab27c) ### [On KL-Divergence and Context Size Optimization in GGUF Quantization](https://selfenrichment.hashnode.dev/on-kl-divergence-and-context-size-optimization-in-gguf-quantization?utm_source=hashnode&utm_medium=feed) note: This paper was written with AI, and the exploration it describes was done collaboratively with AI. The "we" described here is us; me and a few models. With llama.cpp model quantization, properly adjusting models to keep their performance after ... 13 min read · [selfenrichment.hashnode.dev](https://selfenrichment.hashnode.dev/on-kl-divergence-and-context-size-optimization-in-gguf-quantization?utm_source=hashnode&utm_medium=feed) [Kevin Loggenberg](https://hashnode.com/@TheCodesmith) · [Jul 9, 2024](https://hashnode.com/posts/local-llms-with-net/668cfc240ce234418bc89246) ### [Local LLM's with .Net](https://thecodesmith.hashnode.dev/local-llms-with-net?utm_source=hashnode&utm_medium=feed) Phi3/Mistral/TinyLamma CPU inference with Llamasharp 3 min read · [thecodesmith.hashnode.dev](https://thecodesmith.hashnode.dev/local-llms-with-net?utm_source=hashnode&utm_medium=feed) [1](https://hashnode.com/posts/local-llms-with-net/668cfc240ce234418bc89246)