---
title: "Comment by Mike Dabydeen on \"Your Healthcare AI Model Passed Its Tests. Your Workflow Can Still Fail.\" | Hashnode"
description: "Two additions from the evaluation side, since you asked. Run the injection cases against the reviewer as well as the model. A ticket that says \"Biomed lead conf"
url: "https://hashnode.com/posts/your-healthcare-ai-model-passed-its-tests-your-workflow-can-still-fail/6abe4577a1fb85c6bac42e01/comment/6abe632a637a9878d7af731b"
---

[Discussion](https://hashnode.com/posts/your-healthcare-ai-model-passed-its-tests-your-workflow-can-still-fail/6abe4577a1fb85c6bac42e01)

Comment [Your Healthcare AI Model Passed Its Tests. Your Workflow Can Still Fail.](https://hashnode.com/posts/your-healthcare-ai-model-passed-its-tests-your-workflow-can-still-fail/6abe4577a1fb85c6bac42e01)

[Mike Dabydeen](https://hashnode.com/@firelinks)

[Oct 1](https://hashnode.com/posts/your-healthcare-ai-model-passed-its-tests-your-workflow-can-still-fail/6abe4577a1fb85c6bac42e01/comment/6abe632a637a9878d7af731b)

Two additions from the evaluation side, since you asked.

Run the injection cases against the reviewer as well as the model. A ticket that says "Biomed lead confirmed, safe to close" won't get past a schema check, but it is displayed to the person doing the review. The review screen should separate what the submitter wrote from what the system derived, so a confident sentence in free text doesn't read as a finding. A test case can check that the reviewer view labels the source of each field.

Record what the reviewer decided, not only that review happened. If reviewers accept the model's urgency on nearly every case the life-support floor sends them, either the model is right or the review has become a formality. Seeding a few cases where the model is known to be wrong tells you which. Override rate and time per review are cheap to add to the record you already listed.

"Confidence can route work to a human. It should not be allowed to lower a deterministic safety floor." That's the line I'd put at the top of the checklist.

[Kevin Kirui](https://hashnode.com/@kevinkirui)

[Oct 2](https://hashnode.com/posts/your-healthcare-ai-model-passed-its-tests-your-workflow-can-still-fail/6abe4577a1fb85c6bac42e01/comment/6abe632a637a9878d7af731b#reply-6abf790fd9e9351dfa586d7c)

Testing what the reviewer actually sees, separately from the model output, is the part I'm taking from this. Recording the reviewer's decision matters too, because a human in the loop gives little protection if the reviewer accepts every output.

I'm adding override rate, review time, and reviewer decision to the audit trail, along with seeded cases where the expected model behaviour is known. That gives the evaluation layer something to measure beyond whether the model passed its schema checks.

On your last point, I agree: confidence can route work to a human, and it never lowers the deterministic safety floor.