---
title: "Discussion on \"Understanding GPT Tokenization — A Complete Beginner-to-Deep Guide\" | Hashnode"
description: "Discussion on \"Understanding GPT Tokenization — A Complete Beginner-to-Deep Guide\". What Problem Are We Actually Solving?\nBefore we talk about tokenization, let’s understand the real situation.\nA Large Language Model (LLM) like GPT does not understand:\n\nLetters\n\nWords\n\nGrammar\n\nMeaning\n\n\nIt understands numbers and vectors.\nWhen you ..."
url: "https://hashnode.com/posts/understanding-gpt-tokenization-a-complete-beginner-to-deep-guide/698f4bc3048d0184fd643585"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Understanding GPT Tokenization — A Complete Beginner-to-Deep Guide](https://tokenizers-in-gpt.hashnode.dev/understanding-gpt-tokenization-a-complete-beginner-to-deep-guide?utm_source=hashnode&utm_medium=feed)

What Problem Are We Actually Solving? Before we talk about tokenization, let’s understand the real situation. A Large Language Model (LLM) like GPT does not understand: Letters Words Grammar Meaning It understands numbers and vectors. When you ...

Feb 13 · 6 min read · tokenizers-in-gpt.hashnode.dev  
Read the article

-   [#programming-blogs](https://hashnode.com/tag/programming-blogs)
-   [#genai](https://hashnode.com/tag/genai)
-   [#generative-ai](https://hashnode.com/tag/generative-ai)
-   [#chatgpt](https://hashnode.com/tag/chatgpt)

## Written by

[Abhay Verma](https://hashnode.com/@abhay329)

@abhay329

  
[View profile](https://hashnode.com/@abhay329)

A learner.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
