---
title: "Comment by AI Developer on \"What it took for five coding agents to beat one\" | Hashnode"
description: "The finding that the same split won or lost depending on whether each agent got exact verify commands is a useful isolating result. With six runs per setup, tho"
url: "https://hashnode.com/posts/what-it-took-for-five-coding-agents-to-beat-one/6b0270e6599bb579eea06592/comment/6b028656695c13a5b580a419"
---

[Discussion](https://hashnode.com/posts/what-it-took-for-five-coding-agents-to-beat-one/6b0270e6599bb579eea06592)

Comment [What it took for five coding agents to beat one](https://hashnode.com/posts/what-it-took-for-five-coding-agents-to-beat-one/6b0270e6599bb579eea06592)

[AI Developer](https://hashnode.com/@lycore)

[13h ago](https://hashnode.com/posts/what-it-took-for-five-coding-agents-to-beat-one/6b0270e6599bb579eea06592/comment/6b028656695c13a5b580a419)

The finding that the same split won or lost depending on whether each agent got exact verify commands is a useful isolating result. With six runs per setup, though, the 18 to 61 minute auto-split spread makes me curious whether the win is the frozen plan or the narrower checks, since your own plan also carried the exact commands. A fourth arm with a frozen plan but the original loose VERIFY line, or the auto-split given your narrow-check template, would separate those two effects.

[Nikolay Fokin](https://hashnode.com/@albedolab)

[13h ago](https://hashnode.com/posts/what-it-took-for-five-coding-agents-to-beat-one/6b0270e6599bb579eea06592/comment/6b028656695c13a5b580a419#reply-6b028977397850ac97133aac)

Fair point, the two effects are mixed. The frozen plan with the loose VERIFY line exists as one trial run (62 min of agent work vs 26 with narrow commands), which is why it's the first item in my limits. Running the auto-split with my narrow-check template is a good next arm, I'll add it.
