---
title: "Discussion on \"Building My Own LLM: A Journey into Language Models Building a Tokenizer   🛠️\" | Hashnode"
description: "Discussion on \"Building My Own LLM: A Journey into Language Models Building a Tokenizer   🛠️\". In this blog post, I talk about how to build a tokenizer to be used for an LLM."
url: "https://hashnode.com/posts/building-my-own-llm-a-journey-into-language-models-building-a-tokenizer/668fc967b39b840a9585928b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building My Own LLM: A Journey into Language Models Building a Tokenizer 🛠️](https://theclouddude.co.uk/building-my-own-llm-a-journey-into-language-models-building-a-tokenizer?utm_source=hashnode&utm_medium=feed)

In this blog post, I talk about how to build a tokenizer to be used for an LLM.

Jul 11, 2024 · 6 min read · theclouddude.co.uk  
Updated Jul 19, 2024  
Read the article

-   [#python](https://hashnode.com/tag/python)
-   [#python3](https://hashnode.com/tag/python3)
-   [#go](https://hashnode.com/tag/go)
-   [#ai](https://hashnode.com/tag/ai)
-   [#llm](https://hashnode.com/tag/llm)
-   [#chatgpt](https://hashnode.com/tag/chatgpt)
-   [#chatbot](https://hashnode.com/tag/chatbot)
-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)

## Written by

[Jason](https://hashnode.com/@theclouddude)

@theclouddude

  
[View profile](https://hashnode.com/@theclouddude)

Trying to use Go in all different environments

I am a cloud engineer, and I specialise in writing Go and Python to interact with the various cloud SDKs in AWS and Azure. Some GCP and Hetzner

## Responses

Markdown supported · ⌘↵ to post

No responses yet.