The golden set stopped catching regressions the day traffic changed
TL;DR. Our overall eval pass rate read 0.88 through a model change and looked stable. Sliced by request language, German had fallen to 0.60 while English held near 0.90. The aggregate hid that because
ethanwalkerwrites.hashnode.dev8 min read