The eval set you keep meaning to write is already in your logs

Every team I have worked with has the same empty file somewhere in the repo: evals/cases.jsonl, three examples deep, last touched the week someone decided evals mattered. Writing more feels like homew