What an LLM Actually Is (and Why Predicting Words Works)

An LLM is a gigantic probability calculator. It takes a sequence of words (tokens), runs them through a stack of transformer layers, and outputs a distribution over the next possible word. Pick one, f