---
title: "#bpe articles | Hashnode"
description: "Explore 6 articles tagged #bpe on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/bpe"
---

Tag

# #bpe

6 posts · 0 followers

[PUNITH](https://hashnode.com/@punith-v) · [Jun 28](https://hashnode.com/posts/how-i-built-a-bpe-tokenizer-from-scratch-part-1-training/6a416a2f3abbac56183b9a5d)

### [How I Built a BPE Tokenizer from Scratch (Part 1: Training)](https://bpe-tokenizer.hashnode.dev/how-i-built-a-bpe-tokenizer-from-scratch-part-1-training?utm_source=hashnode&utm_medium=feed)

I wanted to actually understand how tokenization works — not just use a library. So I built a BPE tokenizer from scratch. This is Part 1: training the tokenizer, counting pairs, and building the vocabulary.

5 min read · [bpe-tokenizer.hashnode.dev](https://bpe-tokenizer.hashnode.dev/how-i-built-a-bpe-tokenizer-from-scratch-part-1-training?utm_source=hashnode&utm_medium=feed)

[Tushar Singla](https://hashnode.com/@tusharsingla) · [Mar 24](https://hashnode.com/posts/i-built-the-algorithm-behind-chatgpt-from-scratch-here-s-what-i-learned/69c23eab30a9b81e3a1788b9)

### [I built the algorithm behind ChatGPT from scratch — here's what I learned](https://queued.hashnode.dev/i-built-the-algorithm-behind-chatgpt-from-scratch-here-s-what-i-learned?utm_source=hashnode&utm_medium=feed)

How I built a bilingual BPE tokenizer in pure Python — no ML libraries, trained on 1GB of English + Hindi text. Here's what I learned.

11 min read · [queued.hashnode.dev](https://queued.hashnode.dev/i-built-the-algorithm-behind-chatgpt-from-scratch-here-s-what-i-learned?utm_source=hashnode&utm_medium=feed)

[Dhiya Adli](https://hashnode.com/@dhiya-adli) · [Aug 26, 2025](https://hashnode.com/posts/bpe-vs-wordpiece-vs-sentencepiece-a-beginner-friendly-guide-to-subword-tokenization/68ad6a22f1f83df71b2b0afe)

### [BPE vs WordPiece vs SentencePiece: A Beginner-Friendly Guide to Subword Tokenization](https://dhiya-adli.hashnode.dev/bpe-vs-wordpiece-vs-sentencepiece-a-beginner-friendly-guide-to-subword-tokenization?utm_source=hashnode&utm_medium=feed)

A beginner-friendly guide to subword tokenization. Compare BPE, WordPiece, and SentencePiece to see how modern NLP models handle text efficiently.

10 min read · [dhiya-adli.hashnode.dev](https://dhiya-adli.hashnode.dev/bpe-vs-wordpiece-vs-sentencepiece-a-beginner-friendly-guide-to-subword-tokenization?utm_source=hashnode&utm_medium=feed)

[Rahul Kumar](https://hashnode.com/@rahul-713) · [Apr 8, 2025](https://hashnode.com/posts/zero-to-hero-tokenization-in-nlp-from-basics-to-subword-models/67f515c2ed0a095138137dc4)

### [🔍 Zero to Hero: Tokenization in NLP – From Basics to Subword Models](https://data-science-notes.hashnode.dev/zero-to-hero-tokenization-in-nlp-from-basics-to-subword-models?utm_source=hashnode&utm_medium=feed)

✨ “How can machines read language?” That's the fundamental question behind tokenization, the process of breaking down raw text into manageable, machine-readable pieces. If you're on your journey to becoming a data scientist or working with Natural La...

7 min read · [data-science-notes.hashnode.dev](https://data-science-notes.hashnode.dev/zero-to-hero-tokenization-in-nlp-from-basics-to-subword-models?utm_source=hashnode&utm_medium=feed)
