---
title: "Discussion on \"LLM-as-a-Judge Bias: Why Your Eval Score Climbs While Your Answers Get Worse\" | Hashnode"
description: "Discussion on \"LLM-as-a-Judge Bias: Why Your Eval Score Climbs While Your Answers Get Worse\". Position, length, and self-preference bias in LLM judges, with the swap test, the pad test, and the calibration code to catch them"
url: "https://hashnode.com/posts/llm-as-a-judge-bias/6ad5a6517f8b9ebbd4a1f570"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [LLM-as-a-Judge Bias: Why Your Eval Score Climbs While Your Answers Get Worse](https://simplyexplained.hashnode.dev/llm-as-a-judge-bias?utm_source=hashnode&utm_medium=feed)

Position, length, and self-preference bias in LLM judges, with the swap test, the pad test, and the calibration code to catch them

Oct 19 · 11 min read · simplyexplained.hashnode.dev  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#ai-evaluation](https://hashnode.com/tag/ai-evaluation)
-   [#software-engineering](https://hashnode.com/tag/software-engineering)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#generative-ai-tools](https://hashnode.com/tag/generative-ai-tools)

## Written by

[Adam Jaber](https://hashnode.com/@adamjaber)

@adamjaber · Delhi, India

  
[View profile](https://hashnode.com/@adamjaber)

Senior engineer. How AI and software work — and where they quietly break.

I'm a senior software engineer. I write Simply Explained, a plain-English breakdown of how AI and software actually work, and the quiet ways they break: AI fixes that hide bugs, agents that pick the wrong tool, health checks that take down healthy servers. One symptom, one analogy, one fix per piece. New here? Start with the pinned Start Here guide, or get one breakdown a week by email.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.