---
title: "Discussion on \"A second look: auditing Terminal-Bench 4.0 after the big audit\" | Hashnode"
description: "Discussion on \"A second look: auditing Terminal-Bench 4.0 after the big audit\". I ran a cheap test-reading audit on Terminal-Bench 4.0 after a major audit. All 24 wrong solutions passed; 10 were already known, 9 were new."
url: "https://hashnode.com/posts/a-second-look-auditing-terminal-bench-4-0-after-the-big-audit/6af499c4d03a0c139aa7ca99"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [A second look: auditing Terminal-Bench 4.0 after the big audit](https://thegradersaidyes.hashnode.dev/a-second-look-auditing-terminal-bench-4-0-after-the-big-audit?utm_source=hashnode&utm_medium=feed)

I ran a cheap test-reading audit on Terminal-Bench 4.0 after a major audit. All 24 wrong solutions passed; 10 were already known, 9 were new.

7h ago · 8 min read · thegradersaidyes.hashnode.dev  
Read the article

-   [#audit](https://hashnode.com/tag/audit)
-   [#terminal-bench](https://hashnode.com/tag/terminal-bench)
-   [#ai](https://hashnode.com/tag/ai)
-   [#grader](https://hashnode.com/tag/grader)
-   [#benchmark](https://hashnode.com/tag/benchmark)
-   [#claude](https://hashnode.com/tag/claude)
-   [#docker](https://hashnode.com/tag/docker)

## Written by

[Ishan Nerlekar](https://hashnode.com/@ishan-)

@ishan- · Mumbai, India

  
[View profile](https://hashnode.com/@ishan-)

sub(standard)stack

I actually like being an engineer

## Responses 1

Markdown supported · ⌘↵ to post

[OneLifeVibe](https://hashnode.com/@onelifevibe)

[3h ago](https://hashnode.com/posts/a-second-look-auditing-terminal-bench-4-0-after-the-big-audit/6af499c4d03a0c139aa7ca99/comment/6af4da0a720b656f2be9bbd4)

The four gap patterns are the most useful part for me. Fixed inputs missing the deciding case and subset checks that never reject extras are exactly the kind of leniency that looks like a pass until a wrong solution walks through it. I also appreciated the honest what I got wrong section, especially checking the tracker last. Treating the overlap with the bigger audit as a precision check, not a disappointment, made the 9 new gaps land harder.