---
title: "Comment by Julian Neagu on \"Choosing the Right OpenAI Model and Reasoning Level\" | Hashnode"
description: "The repeat runs are the part that stood out to me. A model can look solid on one pass, then miss the same kind of task later."
url: "https://hashnode.com/posts/choosing-the-right-openai-model-and-reasoning-level/6abf0d0682c3fdfa1bc9ab22/comment/6ac374c1f30dd6567cecec37"
---

[Discussion](https://hashnode.com/posts/choosing-the-right-openai-model-and-reasoning-level/6abf0d0682c3fdfa1bc9ab22)

Comment [Choosing the Right OpenAI Model and Reasoning Level](https://hashnode.com/posts/choosing-the-right-openai-model-and-reasoning-level/6abf0d0682c3fdfa1bc9ab22)

[Julian Neagu](https://hashnode.com/@julianneagulab)

[Oct 5](https://hashnode.com/posts/choosing-the-right-openai-model-and-reasoning-level/6abf0d0682c3fdfa1bc9ab22/comment/6ac374c1f30dd6567cecec37)

The repeat runs are the part that stood out to me. A model can look solid on one pass, then miss the same kind of task later.

[Gary Stafford](https://hashnode.com/@garystafford)

[1d ago](https://hashnode.com/posts/choosing-the-right-openai-model-and-reasoning-level/6abf0d0682c3fdfa1bc9ab22/comment/6ac374c1f30dd6567cecec37#reply-6af36a3bb23a0def963c9da0)

Thanks, Julian. GPT-6 Sol at low reasoning got all 27 tasks right on the first pass, then scored 26/27 and 25/27 on the same tasks. On the regional failover task, the two later runs proposed plans costing $290 and $350 against a $260 optimum. The first pass would have put Sol/low on the shortlist. The repeats showed it missed our per-task requirement even though its overall accuracy stayed above 95%.