Explain Tokenization to fresher
In Generative AI, models like ChatGPT, Gemini don’t read text as letters or words like humans do.They break it into chunks called tokens, which are just numbers the model can understand.
So, In digital world all is numbers, Computers work with number...
santoshdev.hashnode.dev2 min read