356 of the 528 eval cases we could judge have never failed. Our pass rate could only move 21 points.
TL;DR: I broke out per-case results for the incident-harvested part of our eval suite, 611 of our 1,400 cases, and asked which cases have ever discriminated between two shipped versions. Of the 528 wi
ethanwalkerwrites.hashnode.dev8 min read