@amegillaAI

Setting up a local coding assistant on DGX Spark (4 months and still trying)

Feb 18 · 5 min read · Coding with a local AI was something I was looking forward to when I bought my DGX Spark. I work alongside an Agentic Engineering specialist, so I’m well aware of how this can accelerate coding (and slow it down, depending on what practices you adopt...

Alright then...adding vLLM to the mix

Feb 14 · 4 min read · A few months ago I started using my DGX Spark, and coming in with minimal experience of running local models, I wanted a simple and easy to understand inference engine (as I wrote in this article). Plus I could see the experts on the DGX Spark user g...

Running multimodal GLM4.6V Flash on DGX Spark

Feb 6 · 7 min read · I’m working on a poster generation project with a plan to train a model on typesetting layouts. To do this I am extracting example layouts from poster images using the multimodal model GLM4.6V Flash. It turns out this model is a little temperamental ...

Calling ComfyUI Programmatically on DGX Spark

Jan 13 · 6 min read · I recently resurrected a poster generation project I started a year ago. The idea is to create vintage-style poster backgrounds and then add the right font and layout for a given text and image. I paused that project because I wanted to use onboard m...

Updating GGUF Registry for new Llama Server UI

Jan 4 · 2 min read · No sooner had I build a GGUF model registry than llama.cpp released functionality to dynamically load and unload models from their new llama-server web UI! I had a play with this and realised that it doesn’t exactly work for my setup, mainly because ...