LLM-as-a-Judge Bias: Why Your Eval Score Climbs While Your Answers Get Worse

Here's an experiment you can run on your eval setup in five minutes. Take one question from your test set and two candidate answers. Ask your LLM judge which is better. Then ask again with the two ans