Tokens vs Bytes in AI: What LLMs Actually See When You Type
You type "你好 Hello" into GPT-5. That's 7 characters. But the model processes it as 2 tokens — and your bill is based on those tokens, not the characters.
Meanwhile, your computer stores that same text as 12 bytes.
So what's the difference between byt...
xufjcn.hashnode.dev3 min read