IDInternals Decodedininternals-decoded.hashnode.dev·2h ago · 14 min readEmbeddings: Meaning as NumbersWhen you ask a chatbot for a pasta recipe, it doesn’t understand “pasta” the way you do. It sees a list of numbers. Those numbers are not random. They are arranged so that “pasta” sits close to “spagh00
IDInternals Decodedininternals-decoded.hashnode.dev·2d ago · 15 min readAttention, Gently: How Models Decide What MattersIn the first two parts of this series, you saw that a large language model’s whole job is to guess the next word, and you learned that it chops your sentences into tiny pieces called tokens. The quest00
IDInternals Decodedininternals-decoded.hashnode.dev·4d ago · 13 min readTokens: The Currency of AIWhen you ask a chatbot for a recipe, it does not see words. It sees tokens. Every phrase you type gets chopped into small, numbered pieces. Those pieces are the thing you pay for, the thing that fills00
IDInternals Decodedininternals-decoded.hashnode.dev·5d ago · 13 min readWhat an LLM Actually Is (and Why Predicting Words Works)An LLM is a gigantic probability calculator. It takes a sequence of words (tokens), runs them through a stack of transformer layers, and outputs a distribution over the next possible word. Pick one, f00
