Our eval gate runs 22 minutes. The queue behind it hit three hours.
Nobody complained about the gate. They complained about Tuesday.
Our merge queue runs the full eval suite before anything lands: 1,400 cases, about 240 of them scored by an LLM judge, the rest determi
ethanwalkerwrites.hashnode.dev6 min read