---
title: "Discussion on \"Vision Yatra: Step 16 — The Final Layer: Linear & Softmax — How Transformers Generate Words\" | Hashnode"
description: "Discussion on \"Vision Yatra: Step 16 — The Final Layer: Linear & Softmax — How Transformers Generate Words\". From vectors to words — the secret behind text generation in ChatGPT and BERT"
url: "https://hashnode.com/posts/vision-yatra-step-16-the-final-layer-linear-and-softmax-how-transformers-generate-words/68a86cbb4474a7e82250b21a"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Vision Yatra: Step 16 — The Final Layer: Linear & Softmax — How Transformers Generate Words](https://my-ai-yatra.solveautomation.in/vision-yatra-step-16-the-final-layer-linear-and-softmax-how-transformers-generate-words?utm_source=hashnode&utm_medium=feed)

From vectors to words — the secret behind text generation in ChatGPT and BERT

Aug 22, 2025 · 6 min read · my-ai-yatra.solveautomation.in  
Read the article

-   [#ai-yatra](https://hashnode.com/tag/ai-yatra)

## Written by

[Pankaj Kumar](https://hashnode.com/@pankajhyd)

@pankajhyd · Hyderabad

  
[View profile](https://hashnode.com/@pankajhyd)

automation code point

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
