---
title: "Discussion on \"Tokenization - For Freshers\" | Hashnode"
description: "Discussion on \"Tokenization - For Freshers\". Imagine you have a big storybook .If you try to read the whole thing in one breath, you’ll pass out faster than India chasing 350 without Kohli.So you split it into words and sentences.\nNow you can read it bit by bit.That’s exactly what tokenization ..."
url: "https://hashnode.com/posts/tokenization-for-freshers/689b4a228b20ba2cb4f4b65c"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Tokenization - For Freshers](https://jakhar1997.hashnode.dev/tokenization-for-freshers?utm_source=hashnode&utm_medium=feed)

Imagine you have a big storybook .If you try to read the whole thing in one breath, you’ll pass out faster than India chasing 350 without Kohli.So you split it into words and sentences. Now you can read it bit by bit.That’s exactly what tokenization ...

Aug 12, 2025 · 1 min read · jakhar1997.hashnode.dev  
Read the article

-   [#chaicode](https://hashnode.com/tag/chaicode)
-   [#generative-ai](https://hashnode.com/tag/generative-ai)
-   [#tokenization](https://hashnode.com/tag/tokenization)
-   [#genai-cohort](https://hashnode.com/tag/genai-cohort)

## Written by

[Jaswant singh](https://hashnode.com/@jakhar1997)

@jakhar1997

  
[View profile](https://hashnode.com/@jakhar1997)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.