Part 1: RAID, Rust, and a Very Stubborn Memory Allocator
The Idea
I’ve had a local AI stack running for a while now: Hermes on WhatsApp, Gemma 4 on CPU, two Hailo AI HAT+ boards handling NPU inference, and Open WebUI tying most of it together.
It was good a
accidentalcomplexity.hashnode.dev9 min read