
No sooner had I build a GGUF model registry than llama.cpp released functionality to dynamically load and unload models from their new llama-server web UI! I had a play with this and realised that it doesn’t exactly work for my setup, mainly because ...
Building things, breaking them, trying again (and again)
Exploring AI in my free time while holding down a job working with startups at one of the Magnificent Seven
Markdown supported · ⌘↵ to post
No responses yet.