---
title: "Discussion on \"Attention is all you need\" | Hashnode"
description: "Discussion on \"Attention is all you need\". The Transformer is a sequence-to-sequence (transduction) model that replaces sequence-aligned RNNs and convolutions with attention mechanisms. It uses self-attention to relate positions within a sequence and cross-attention to connect input and output sequences, enabling direct modeling of long-range dependencies and highly parallel computation."
url: "https://hashnode.com/posts/attention-is-all-you-need/6aafd8e3b7a56266cade2b04"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Attention is all you need](https://adarsh9.hashnode.dev/attention-is-all-you-need?utm_source=hashnode&utm_medium=feed)

The Transformer is a sequence-to-sequence (transduction) model that replaces sequence-aligned RNNs and convolutions with attention mechanisms. It uses self-attention to relate positions within a sequence and cross-attention to connect input and output sequences, enabling direct modeling of long-range dependencies and highly parallel computation.

Sep 20 · 7 min read · adarsh9.hashnode.dev  
Read the article

## Written by

[AdarsH](https://hashnode.com/@AKACHI)

@AKACHI · Dehradun, Uttarakhand, India

  
[View profile](https://hashnode.com/@AKACHI)

#AKACHI

Hare Krishna 🌼

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
