---
title: "#sentencepiece articles | Hashnode"
description: "Explore 3 articles tagged #sentencepiece on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/sentencepiece"
---

Tag

# #sentencepiece

3 posts · 0 followers

[Pornima Gaikwad](https://hashnode.com/@pornima1) · [Oct 20, 2025](https://hashnode.com/posts/tokenisation-under-the-hood/68f5f810f355a838b414c424)

### [Tokenisation under the Hood](https://llmtokenizer.hashnode.dev/tokenisation-under-the-hood?utm_source=hashnode&utm_medium=feed)

Tokenisation From Scratch: Building the Bridge Between Text and AI Understanding the translation layer that powers every large language model When you type a message to ChatGPT, Llama, or any other language model, something magical happens behind the...

10 min read · [llmtokenizer.hashnode.dev](https://llmtokenizer.hashnode.dev/tokenisation-under-the-hood?utm_source=hashnode&utm_medium=feed)

[Dhiya Adli](https://hashnode.com/@dhiya-adli) · [Aug 26, 2025](https://hashnode.com/posts/bpe-vs-wordpiece-vs-sentencepiece-a-beginner-friendly-guide-to-subword-tokenization/68ad6a22f1f83df71b2b0afe)

### [BPE vs WordPiece vs SentencePiece: A Beginner-Friendly Guide to Subword Tokenization](https://dhiya-adli.hashnode.dev/bpe-vs-wordpiece-vs-sentencepiece-a-beginner-friendly-guide-to-subword-tokenization?utm_source=hashnode&utm_medium=feed)

A beginner-friendly guide to subword tokenization. Compare BPE, WordPiece, and SentencePiece to see how modern NLP models handle text efficiently.

10 min read · [dhiya-adli.hashnode.dev](https://dhiya-adli.hashnode.dev/bpe-vs-wordpiece-vs-sentencepiece-a-beginner-friendly-guide-to-subword-tokenization?utm_source=hashnode&utm_medium=feed)

[Rahul Kumar](https://hashnode.com/@rahul-713) · [Apr 8, 2025](https://hashnode.com/posts/zero-to-hero-tokenization-in-nlp-from-basics-to-subword-models/67f515c2ed0a095138137dc4)

### [🔍 Zero to Hero: Tokenization in NLP – From Basics to Subword Models](https://data-science-notes.hashnode.dev/zero-to-hero-tokenization-in-nlp-from-basics-to-subword-models?utm_source=hashnode&utm_medium=feed)

✨ “How can machines read language?” That's the fundamental question behind tokenization, the process of breaking down raw text into manageable, machine-readable pieces. If you're on your journey to becoming a data scientist or working with Natural La...

7 min read · [data-science-notes.hashnode.dev](https://data-science-notes.hashnode.dev/zero-to-hero-tokenization-in-nlp-from-basics-to-subword-models?utm_source=hashnode&utm_medium=feed)
