Tokenizers Explained — How GPT, Claude, LLaMA and BERT Actually Read Your Text

When you send a prompt to ChatGPT, Claude, or any large language model, the model never actually sees your text. It sees numbers. Just numbers. The thing that converts your text into numbers — and bac