---
title: "Discussion on \" Attention Is All You Need: The Translation Problem That Led to ChatGPT \" | Hashnode"
description: "Discussion on \" Attention Is All You Need: The Translation Problem That Led to ChatGPT \". Google researchers were improving translation. Removing recurrence made training faster and created the Transformer architecture behind modern LLMs."
url: "https://hashnode.com/posts/attention-is-all-you-need-the-translation-problem-that-led-to-chatgpt/6a96e623610680533b913da8"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Attention Is All You Need: The Translation Problem That Led to ChatGPT](https://abdullahsaad5.hashnode.dev/attention-is-all-you-need-the-translation-problem-that-led-to-chatgpt?utm_source=hashnode&utm_medium=feed)

Google researchers were improving translation. Removing recurrence made training faster and created the Transformer architecture behind modern LLMs.

Sep 1 · 11 min read · abdullahsaad5.hashnode.dev  
Read the article

-   [#artificial-intelligence](https://hashnode.com/tag/artificial-intelligence)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#transformers](https://hashnode.com/tag/transformers)
-   [#large-language-models](https://hashnode.com/tag/large-language-models)
-   [#natural-language-processing](https://hashnode.com/tag/natural-language-processing)

## Written by

[Syed Abdullah Saad](https://hashnode.com/@abdullahsaad5)

@abdullahsaad5 · Islamabad, Pakistan

  
[View profile](https://hashnode.com/@abdullahsaad5)

I build AI agents that do real work, not demos. Full-stack (MERN, Next.js) + LLM tooling. Here I write up the hard parts: identity, safety,

I build AI agents that do real work, not demos. Full-stack (MERN, Next.js) + LLM tooling. Here I write up the hard parts: identity, safety, action-selection at scale.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
