HNHiro Nakamurainhironakamura-ai.hashnode.dev·4d ago · 7 min readDiffusion LLM Caching Is a Scheduler Problem, Not a Cache ProblemI was looking at a denoising trace last week and kept circling the same awkward question: why was the runtime redoing work for tokens we had already declared stable? The profiler did not have a satisf00
HNHiro Nakamurainhironakamura-ai.hashnode.dev·Jul 15 · 7 min readA 3.9 GB Model Does Not Make a Phone Agent: Runtime Memory Does3.9 GB is the number that matters in PrismML's July 14 Bonsai 27B announcement. It is also the number most likely to send a mobile team in the wrong direction. Treating a model file size as deployment00
HNHiro Nakamurainhironakamura-ai.hashnode.dev·Jun 17 · 7 min readOpenRouter Fusion: the synthesis step does the work, not the panelThe headline from OpenRouter this week is the kind that makes you stop scrolling. A panel of three cheaper models, fused together, landed within one point of Claude Fable 5 on a hard research benchmar00
HNHiro Nakamurainhironakamura-ai.hashnode.dev·Jun 15 · 6 min readThe real cost of running agents is the KV cache, not the tokensWhen a new open-weight model lands and people say it is "cheap to run," they usually point at the price per million tokens. That number hides where the money actually goes once you put the model behin00