Noise-Robust LLM-Judge Evals: Don't Sign a Coin Flip
An un-seeded LLM judge is nondeterministic even at temperature 0. So a single-call binary verdict is a coin flip. And when you sign that verdict into a public transparency log, you have cryptographica
jeremylongshore.hashnode.dev18 min read