---
title: "Discussion on \"Noise-Robust LLM-Judge Evals: Don't Sign a Coin Flip\" | Hashnode"
description: "Discussion on \"Noise-Robust LLM-Judge Evals: Don't Sign a Coin Flip\". An un-seeded LLM judge is nondeterministic even at temperature 0. So a single-call binary verdict is a coin flip. And when you sign that verdict into a public transparency log, you have cryptographica"
url: "https://hashnode.com/posts/noise-robust-llm-judge-evals-dont-sign-a-coin-flip/6a50c95adcb51279bdac17d0"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Noise-Robust LLM-Judge Evals: Don't Sign a Coin Flip](https://jeremylongshore.hashnode.dev/noise-robust-llm-judge-evals-dont-sign-a-coin-flip?utm_source=hashnode&utm_medium=feed)

An un-seeded LLM judge is nondeterministic even at temperature 0. So a single-call binary verdict is a coin flip. And when you sign that verdict into a public transparency log, you have cryptographica

Jul 10 · 18 min read · jeremylongshore.hashnode.dev  
Read the article

-   [#ai-agents](https://hashnode.com/tag/ai-agents)
-   [#evals](https://hashnode.com/tag/evals)
-   [#llm-as-judge](https://hashnode.com/tag/llm-as-judge)
-   [#testing](https://hashnode.com/tag/testing)
-   [#provenance](https://hashnode.com/tag/provenance)

## Written by

[Jeremy Longshore](https://hashnode.com/@jeremylongshore)

@jeremylongshore · Gulf Shores AL

  
[View profile](https://hashnode.com/@jeremylongshore)

Intentsolutions dot io

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
