---
title: "Discussion on \"Introduction to Transformers and Self Attention\" | Hashnode"
description: "Discussion on \"Introduction to Transformers and Self Attention\". Wonder how NLP has advanced so much that it can do tasks like translation and text summarization to writing code? Let's go back to the beginning..."
url: "https://hashnode.com/posts/introduction-to-transformers-and-self-attention/64929987c167b41645fd35fd"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Introduction to Transformers and Self Attention](https://kunal221.hashnode.dev/introduction-to-transformers-and-self-attention?utm_source=hashnode&utm_medium=feed)

Wonder how NLP has advanced so much that it can do tasks like translation and text summarization to writing code? Let's go back to the beginning...

Jun 21, 2023 · 14 min read · kunal221.hashnode.dev  
Read the article

-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#natural-language-processing](https://hashnode.com/tag/natural-language-processing)
-   [#chatgpt](https://hashnode.com/tag/chatgpt)
-   [#nlp-transformers](https://hashnode.com/tag/nlp-transformers)
-   [#deep-learning](https://hashnode.com/tag/deep-learning)

## Written by

[Kunal Nayyar](https://hashnode.com/@KunalNayyar)

@KunalNayyar

  
[View profile](https://hashnode.com/@KunalNayyar)

Aspiring Software Engineer , Love to brainstorm and solve problems using code

## Responses 1

Markdown supported · ⌘↵ to post

[Prateek Shokeen](https://hashnode.com/@PrateekShokeen19)

[Jun 22, 2023](https://hashnode.com/posts/introduction-to-transformers-and-self-attention/64929987c167b41645fd35fd/comment/6493c87ef012983651c30e30)

well researched content, loved reading it all :)

[Kunal Nayyar](https://hashnode.com/@KunalNayyar)

[Jun 22, 2023](https://hashnode.com/posts/introduction-to-transformers-and-self-attention/64929987c167b41645fd35fd/comment/6493c87ef012983651c30e30#reply-64946b5cb5816e3bf5a9b7b3)

Thanks Prateek :)
