Alright then...adding vLLM to the mix
A few months ago I started using my DGX Spark, and coming in with minimal experience of running local models, I wanted a simple and easy to understand inference engine (as I wrote in this article). Plus I could see the experts on the DGX Spark user g...
sparktastic.hashnode.dev4 min read