---
title: "Discussion on \"Building a Decoder-Only Transformer from Scratch: A Tiny Shakespeare Experiment\" | Hashnode"
description: "Discussion on \"Building a Decoder-Only Transformer from Scratch: A Tiny Shakespeare Experiment\". 1. Why I Built This\nI’m currently learning how large language models work — not at the level of calling an API, but understanding what’s actually happening inside. This was my first attempt at buildin"
url: "https://hashnode.com/posts/building-a-decoder-only-transformer-from-scratch-a-tiny-shakespeare-experiment/6b00fa89399cb91b6cfe688b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Building a Decoder-Only Transformer from Scratch: A Tiny Shakespeare Experiment](https://gradientsandgroundtruth.hashnode.dev/building-a-decoder-only-transformer-from-scratch-a-tiny-shakespeare-experiment?utm_source=hashnode&utm_medium=feed)

1\. Why I Built This I’m currently learning how large language models work — not at the level of calling an API, but understanding what’s actually happening inside. This was my first attempt at buildin

8h ago · 11 min read · gradientsandgroundtruth.hashnode.dev  
Read the article

-   [#pytorch](https://hashnode.com/tag/pytorch)
-   [#deeplearning](https://hashnode.com/tag/deeplearning)
-   [#nlp](https://hashnode.com/tag/nlp)
-   [#transformers](https://hashnode.com/tag/transformers)
-   [#python](https://hashnode.com/tag/python)

## Written by

[Siya](https://hashnode.com/@sia3136)

@sia3136

  
[View profile](https://hashnode.com/@sia3136)

AI Engineer in the making | Building & exploring intelligent systems

I like understanding problems beyond their surface, exploring different approaches, and figuring out how to build better solutions. Currently exploring deep learning, NLP and LLMs through hands-on projects and experiments.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
