---
title: "Discussion on \"A 91% eval pass rate shipped our worst regression. We gate on the delta now.\" | Hashnode"
description: "Discussion on \"A 91% eval pass rate shipped our worst regression. We gate on the delta now.\". Our CI eval gate failed anything under 90%. A change landed at 91%, passed, and shipped a regression that cost us two days. The absolute threshold was the problem. it cannot tell a stable 91% from a 9"
url: "https://hashnode.com/posts/a-91-eval-pass-rate-shipped-our-worst-regression-we-gate-on-the-delta-now/6a834030b5087402bc9ddf30"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [A 91% eval pass rate shipped our worst regression. We gate on the delta now.](https://ethanwalkerwrites.hashnode.dev/a-91-eval-pass-rate-shipped-our-worst-regression-we-gate-on-the-delta-now?utm_source=hashnode&utm_medium=feed)

Our CI eval gate failed anything under 90%. A change landed at 91%, passed, and shipped a regression that cost us two days. The absolute threshold was the problem. it cannot tell a stable 91% from a 9

Aug 17 · 3 min read · ethanwalkerwrites.hashnode.dev  
Read the article

## Written by

[ethanwalker](https://hashnode.com/@ethanwritesai)

@ethanwritesai · San Francisco, USA

  
[View profile](https://hashnode.com/@ethanwritesai)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
