---
title: "Discussion on \"Why Temperature 0 Does Not Make LLM Inference Deterministic\" | Hashnode"
description: "Discussion on \"Why Temperature 0 Does Not Make LLM Inference Deterministic\". A common assumption in AI systems is:\n\nIf temperature is set to 0, the model becomes deterministic.\n\nThat sounds reasonable.\nAfter all, temperature controls randomness during token sampling. If we rem"
url: "https://hashnode.com/posts/why-temperature-0-does-not-make-llm-inference-deterministic/6af1804ee9be2add245e1c98"
---

[Feed](https://hashnode.com/feed) /

Discussion

[Pelloran](https://hashnode.com/@pelloran)

Building verifiable AI infrastructure for trustworthy intelligence.

4h ago

# [Why Temperature 0 Does Not Make LLM Inference Deterministic](https://pelloran.hashnode.dev/why-temperature-0-does-not-make-llm-inference-deterministic?utm_source=hashnode&utm_medium=feed)

A common assumption in AI systems is: If temperature is set to 0, the model becomes deterministic. That sounds reasonable. After all, temperature controls randomness during token sampling. If we rem

pelloran.hashnode.dev 4 min read

[#ai](https://hashnode.com/tag/ai) [#machine-learning](https://hashnode.com/tag/machine-learning) [#opensource](https://hashnode.com/tag/opensource) [#ai-tools](https://hashnode.com/tag/ai-tools) [#distributed-system](https://hashnode.com/tag/distributed-system) [#ai-agents](https://hashnode.com/tag/ai-agents) [#ml](https://hashnode.com/tag/ml) [#rust](https://hashnode.com/tag/rust)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.