Decoding AI Jargon with chai #chaicode
What is AI?
AI = Data + Algorithm
Tokenization
Converting words and assigning them mathematical numbers based on an algorithm is called tokenization.
In short tokenization means converting user input to a number.
If you want to visualize it, you c...
iamsanjeevkrsingh.hashnode.dev3 min read