Typed output validation solves format drift, but a valid schema doesn't guarantee that the agent chose the right action. I'd evaluate routing decisions separately from execution outcomes, and treat validation failure as a hard stop before side effects rather than silently repairing the object and continuing. Otherwise the pipeline can be perfectly type-safe while still taking the wrong action.
Vlad Zoff
Building Codapult and Codapult Guard
Typed output validation solves format drift, but a valid schema doesn't guarantee that the agent chose the right action. I'd evaluate routing decisions separately from execution outcomes, and treat validation failure as a hard stop before side effects rather than silently repairing the object and continuing. Otherwise the pipeline can be perfectly type-safe while still taking the wrong action.