The most expensive model in your agent might be doing the cheapest workAuthor: The rightmodeler team Imagine opening the graph for an agent you shipped six months ago. Every node uses the same frontier model. That does not mean the team was careless. It usually means theJul 10 · 3 min readrightmodeler.hashnode.dev
Why we built a model downgrade report before building a routerAuthor: The rightmodeler team The first version of our model cost tool does not route a single production request. At first, that can sound backwards. If the problem is expensive model calls, why not Jul 10 · 3 min readrightmodeler.hashnode.dev
We were picking models by vibes. Then the bill arrived.Author: The rightmodeler team For most of our careers, we chose the model behind each step in an agent by instinct. That is uncomfortable to admit. We measured latency, retries, tool failures, and almJul 10 · 3 min readrightmodeler.hashnode.dev