---
title: "Discussion on \"How to Build a Large Language Model from Scratch? Toktumi 3.0 – Part 3 (The Final Part)\" | Hashnode"
description: "Discussion on \"How to Build a Large Language Model from Scratch? Toktumi 3.0 – Part 3 (The Final Part)\". Toktumi 3.0 – a Polish-language LLM based on GPT-2. Fine-tuning, 100% synthetic training data. Conclusion: LESS CAN BE MORE."
url: "https://hashnode.com/posts/toktumi-3-en/6af4da9a63e3e8f3d91d5cde"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [How to Build a Large Language Model from Scratch? Toktumi 3.0 – Part 3 (The Final Part)](https://sixfingers.hashnode.dev/toktumi-3-en?utm_source=hashnode&utm_medium=feed)

Toktumi 3.0 – a Polish-language LLM based on GPT-2. Fine-tuning, 100% synthetic training data. Conclusion: LESS CAN BE MORE.

9h ago · 34 min read · sixfingers.hashnode.dev  
Read the article

-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#nlp](https://hashnode.com/tag/nlp)
-   [#gpt-2](https://hashnode.com/tag/gpt-2)
-   [#fine-tuning](https://hashnode.com/tag/fine-tuning)
-   [#synthetic-data](https://hashnode.com/tag/synthetic-data)

## Written by

[Michał Z](https://hashnode.com/@sixfingers)

@sixfingers · Warsaw, Poland

  
[View profile](https://hashnode.com/@sixfingers)

Exploring AI, Big Data, machine learning, NLP, and linguistics

My background combines linguistics and copywriting with Python, Big Data, machine learning, and AI. I'm also interested in data analysis, automation, and natural language processing.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.