Tag feed

#gguf

10 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

VNVũ Nhật Lâmblog.fiscybersec.comMay 30 · 11 min read

Bleeding Llama — CVE-2026-7482: When 300,000 AI Servers Become Targets

Risk Summary CVE-2026-7482 (CVSS 9.1 — Critical) allows an attacker to read heap memory directly from a running Ollama process without any credentials. Using just three API calls, all sensitive data c

0

AAmegillasparktastic.hashnode.devDec 27, 2025 · 5 min read

Creating a GGUF Registry for local models on my DGX Spark

Prior to acquiring a DGX Spark, my experience running local LLMs was limited to basic experimentation with Ollama. So when I got my new toy I went a bit crazy downloading lots of different models. And then ended up with a page of notes containing a l...

0

创创联娱乐开户客服hngj.hashnode.devMay 25, 2025 · 1 min read

开户就送彩金的十大网彩平台推荐

赌博靠谱网络平台娱乐游戏网址：cl033.com 游戏开户经理飞机：【@CL20255】正规实体平台-创联娱乐实体网赌平台-创联游戏联盟实体网赌平台推荐-十大亚洲博彩娱乐-亚洲赌博平台线上开户-线上赌博/APP-十大实体赌博平台推荐-实体网络赌博平台由库拉索岛政府授权，可以从事博彩相关活动。正规博彩十大网站排名平台成立于少年，平台专注于快速发展的国内市场，现在它为全世界的玩家和职业玩家提供服务。毫无疑问，正规博彩十大网站排名平台其实是欧洲全球最受青睐的欢迎正规的知名在线博彩公司。玩家的积极反馈、...

0

华华纳国际开户客服clylkhtj.hashnode.devMay 21, 2025 · 1 min read

网赌实体平台大评比｜十大最佳平台权威推荐

东南亚线上网赌平台合法网上赌场,中国网上合法赌场,最好的网上赌场网赌十大快3平台 — 十大网赌平台推荐网赌最好最大平台-十大最好的网赌平台十大靠谱网赌平台- 网上赌搏网站十大排行全球最大网赌正规平台: 十大赌博靠谱网络平台娱乐游戏网址网站：CL033.com 游戏开户【纸飞机：@CL20255】正规实体平台，东南亚实体大赌场的现场实况连线平台，连续多年占据全球线上娱乐顶级品牌榜！是您在线博彩娱乐的首选平台！现场百家乐、现场龙虎、VIP百家乐、VIP龙虎，牛牛、炸金花、大小、单双...

0

RCRobert Collinsselfenrichment.hashnode.devOct 28, 2024 · 13 min read

On KL-Divergence and Context Size Optimization in GGUF Quantization

note: This paper was written with AI, and the exploration it describes was done collaboratively with AI. The "we" described here is us; me and a few models. With llama.cpp model quantization, properly adjusting models to keep their performance after ...

0

KLKevin Loggenbergthecodesmith.hashnode.devJul 9, 2024 · 3 min read

Local LLM's with .Net

Introduction In this article we will explore performing inference on GGUF models with Llama.cpp using the Llamasharp nuget package. It sounds like it should take longer than it actually does. GGUF models are probably one of the easiest models to work...

1

S

JCJuan Carlos Olamendyjuancolamendy.hashnode.devMar 21, 2024 · 6 min read

Persisting a Model in PyTorch: A Comprehensive Guide

In the evolving landscape of machine learning and deep learning, the ability to persist a model is a crucial step. Imagine training a state-of-the-art model for days or even weeks, only to realize you cannot reliably save and reuse it or just deploy ...

0

KPKaushal Powarwrittenbykaushal.hashnode.devJan 4, 2024 · 3 min read

How to convert HF (safetensors) 🤗 model to gguf

You want to convert Huggingface model to gguf format?I was struggling to tackle the same problem a few days ago. I finetuned a Llama 7B model and the model was saved in safetensor format. I wanted to use gguf model so I searched a lot and found a sol...

0

#gguf

Search Hashnode

#gguf

Explore Hashnode

Trending tags this week

Bleeding Llama — CVE-2026-7482: When 300,000 AI Servers Become Targets

Creating a GGUF Registry for local models on my DGX Spark

开户就送彩金的十大网彩平台推荐

网赌实体平台大评比｜十大最佳平台权威推荐

On KL-Divergence and Context Size Optimization in GGUF Quantization

Local LLM's with .Net

Persisting a Model in PyTorch: A Comprehensive Guide

How to convert HF (safetensors) 🤗 model to gguf