The Engineer’s Guide to LLM Nondeterminism

1. The Core Definition In the context of Large Language Models (LLMs), nondeterminism refers to the phenomenon where the same input prompt ($x$) yields different output sequences ($y$) across different runs, even when the model weights are frozen. Th...