---
title: "Comment by Brian · AI News on \"Your LLM Is Not Deterministic\" | Hashnode"
description: "Evals that run once at launch go stale in a week. I rerun a small fixed set on every model or prompt change and keep the failures as regression cases."
url: "https://hashnode.com/posts/your-llm-is-not-deterministic/6ab7bea99ede15fdac67457d/comment/6ab832bcd9da44d77fece986"
---

[Discussion](https://hashnode.com/posts/your-llm-is-not-deterministic/6ab7bea99ede15fdac67457d)

Comment [Your LLM Is Not Deterministic](https://hashnode.com/posts/your-llm-is-not-deterministic/6ab7bea99ede15fdac67457d)

[Brian · AI News](https://hashnode.com/@brianainews)

[Sep 26](https://hashnode.com/posts/your-llm-is-not-deterministic/6ab7bea99ede15fdac67457d/comment/6ab832bcd9da44d77fece986)

Evals that run once at launch go stale in a week. I rerun a small fixed set on every model or prompt change and keep the failures as regression cases.
