How to convert HF (safetensors) 🤗 model to gguf
You want to convert Huggingface model to gguf format?I was struggling to tackle the same problem a few days ago. I finetuned a Llama 7B model and the model was saved in safetensor format. I wanted to use gguf model so I searched a lot and found a sol...
#llamacpp#2articles1week#llm#huggingface#gguf#llama#large-language-models#inference#artificial-intelligence#nlp
Responses
Markdown supported · ⌘↵ to post
No responses yet.