---
title: "Discussion on \"We back-tested our eval gate against 41 known regressions. It caught 23\" | Hashnode"
description: "Discussion on \"We back-tested our eval gate against 41 known regressions. It caught 23\". The gate had been green for eleven weeks. In the same eleven weeks we rolled back two prompt changes, hotfixed a retrieval config on a Saturday, and shipped a summarizer that started dropping the seco"
url: "https://hashnode.com/posts/we-back-tested-our-eval-gate-against-41-known-regressions-it-caught-23/6a7b52887f5926cb10211e7f"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [We back-tested our eval gate against 41 known regressions. It caught 23](https://ethanwalkerwrites.hashnode.dev/we-back-tested-our-eval-gate-against-41-known-regressions-it-caught-23?utm_source=hashnode&utm_medium=feed)

The gate had been green for eleven weeks. In the same eleven weeks we rolled back two prompt changes, hotfixed a retrieval config on a Saturday, and shipped a summarizer that started dropping the seco

Aug 11 · 10 min read · ethanwalkerwrites.hashnode.dev  
Read the article

## Written by

[ethanwalker](https://hashnode.com/@ethanwritesai)

@ethanwritesai · San Francisco, USA

  
[View profile](https://hashnode.com/@ethanwritesai)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
