Using a mac mini (2012) for LLM inference with KoboldCpp
I have an old by now 2012 Intel Mac Mini. Its one of these amazing machines that still work really well if you dont try to put any 2020-era software on it.
So I have been making it a music server to a
mamonu.hashnode.dev9 min read