Explaining Tokenization to a fresher
Ever wondered how our favourite ChatGpt understands what we ask and gives solutions to the problems, generate code ( which sometimes work ) and sometimes ask us to rewrite the whole database as well? you might have heard some terms like “AI works on ...
bhavy.hashnode.dev4 min read