LLM Evaluators Recognize and Favor Their Own Generations

LLM evaluators are just language models that are instructed to evaluate ouptuts of another model. In self-evaluation the same underlying LLM acts as both the evaluator and the evaluatee. As a result, the neutrality of the evaluator is in question, an...