---
title: "Discussion on \"Tokenization\" | Hashnode"
description: "Discussion on \"Tokenization\". tokenization in easy manner , tokenization in genai , what are tokens , tokens"
url: "https://hashnode.com/posts/tokenization/689c9ccf4f41b4b35cc9a591"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Tokenization](https://chaitraligenaiblog.hashnode.dev/tokenization?utm_source=hashnode&utm_medium=feed)

tokenization in easy manner , tokenization in genai , what are tokens , tokens

Aug 13, 2025 · 3 min read · chaitraligenaiblog.hashnode.dev  
Read the article

-   [#tokenization](https://hashnode.com/tag/tokenization)
-   [#token](https://hashnode.com/tag/token)
-   [#tokens](https://hashnode.com/tag/tokens)
-   [#genai](https://hashnode.com/tag/genai)
-   [#generative-ai](https://hashnode.com/tag/generative-ai)
-   [#genai-cohort](https://hashnode.com/tag/genai-cohort)
-   [#chaicode](https://hashnode.com/tag/chaicode)
-   [#chaiaurcode](https://hashnode.com/tag/chaiaurcode)
-   [#chaicohort](https://hashnode.com/tag/chaicohort)
-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#javascript](https://hashnode.com/tag/javascript)
-   [#python](https://hashnode.com/tag/python)
-   [#bert](https://hashnode.com/tag/bert)
-   [#nltk](https://hashnode.com/tag/nltk)
-   [#chaicode-genai](https://hashnode.com/tag/chaicode-genai)

## Written by

[Chaitrali Kakde](https://hashnode.com/@charu123)

@charu123

  
[View profile](https://hashnode.com/@charu123)

I am a front-end web developer and open source contributor

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
