LLM Hyperparameters Guide: Temperature, Top-P, and Top-K Explained

TLDR: Temperature, Top-p, and Top-k are three sampling controls that determine how "creative" or "deterministic" an LLM's output is. Temperature rescales the probability distribution; Top-k limits the