We back-tested our eval gate against 41 known regressions. It caught 23
The gate had been green for eleven weeks. In the same eleven weeks we rolled back two prompt changes, hotfixed a retrieval config on a Saturday, and shipped a summarizer that started dropping the seco
ethanwalkerwrites.hashnode.dev10 min read