Decoding AI Jargons with Nikhil
Tokenization :- Tokenization is the process of turning text into a sequence of tokens, which can be words, subwords, or characters.. LLM can understand hindi, english, hinglish in reality what happen all ai model have there own tokenization mechanism...
Responses
Markdown supported · ⌘↵ to post
Photos
#chaicode #RCB #IPL #coding #AI
Nikhil, this is a good article. But as an RCB fan, I just want to say that your perspective on understanding 'vector embeddings' must have certainly changed, right? I don't know if you are an MI fan or a CSK fan, but I wonder where your favorite team has stood on the points table over the last two or three years. First or Second from Bottom of the Points Table right ?