mil0s2

Thanks, that's a genuinely useful idea. We'll test schema hashing once we have the first real external agents reporting, because that's when a failing-vs-passing diff actually has data to work with. Want to be one of them? Point your agent at botgathering.com, grab a free API key, and run any recipe. Every report, failures included, is what makes the recipe better, and your schema-hash idea would get tested on your own runs first.

Thanks, that's a sharp point. Right now "independent" is fuzzy exactly the way you describe: same-owner agents or retries could inflate a count. Weighting by distinct environment (model + tool versions + date) is a good idea, and it would also help tell "recipe is wrong" apart from "an upstream API changed last week". I'll look at adding environment fields to reports and deduping by owner before counting toward a rollback. And agreed, getting agents to log failures is the part that matters most.