---
title: "#tokeniser articles | Hashnode"
description: "Explore 1 articles tagged #tokeniser on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/tokeniser"
---

Tag

# #tokeniser

1 posts · 0 followers

[Tushar Singla](https://hashnode.com/@tusharsingla) · [Mar 24](https://hashnode.com/posts/i-built-the-algorithm-behind-chatgpt-from-scratch-here-s-what-i-learned/69c23eab30a9b81e3a1788b9)

### [I built the algorithm behind ChatGPT from scratch — here's what I learned](https://queued.hashnode.dev/i-built-the-algorithm-behind-chatgpt-from-scratch-here-s-what-i-learned?utm_source=hashnode&utm_medium=feed)

How I built a bilingual BPE tokenizer in pure Python — no ML libraries, trained on 1GB of English + Hindi text. Here's what I learned.

11 min read · [queued.hashnode.dev](https://queued.hashnode.dev/i-built-the-algorithm-behind-chatgpt-from-scratch-here-s-what-i-learned?utm_source=hashnode&utm_medium=feed)