---
title: "Discussion on \"Decoding the Decoder: Masked Self-Attention and Cross-Attention in PyTorch\" | Hashnode"
description: "Discussion on \"Decoding the Decoder: Masked Self-Attention and Cross-Attention in PyTorch\". If you’ve been following this \"learning in public\" PyTorch series, we have successfully built the entire Transformer Encoder. We gave it a sentence, mapped it to embeddings, added spatial awareness, a"
url: "https://hashnode.com/posts/decoding-the-decoder-masked-self-attention-and-cross-attention-in-pytorch/69aa3b51b8d41e6dedf0f76e"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Decoding the Decoder: Masked Self-Attention and Cross-Attention in PyTorch](https://shalem-raju.hashnode.dev/decoding-the-decoder-masked-self-attention-and-cross-attention-in-pytorch?utm_source=hashnode&utm_medium=feed)

If you’ve been following this "learning in public" PyTorch series, we have successfully built the entire Transformer Encoder. We gave it a sentence, mapped it to embeddings, added spatial awareness, a

Mar 6 · 5 min read · shalem-raju.hashnode.dev  
Read the article

## Written by

[Shalem Raju S](https://hashnode.com/@Shalem)

@Shalem

  
[View profile](https://hashnode.com/@Shalem)

less buzzword, more build

## Responses

Markdown supported · ⌘↵ to post

No responses yet.