---
title: "#rope articles | Hashnode"
description: "Explore 2 articles tagged #rope on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/rope"
---

Tag

# #rope

2 posts · 0 followers

[Rishi](https://hashnode.com/@rishi2220) · [Jul 22](https://hashnode.com/posts/towards-the-modern-transformer-architecture/6a6090024093ae09cf4fb380)

### [Towards the Modern Transformer Architecture](https://rishi2220.hashnode.dev/towards-the-modern-transformer-architecture?utm_source=hashnode&utm_medium=feed)

A deep dive into how GPT-1's architecture evolved: pre-norm, RMSNorm, SwiGLU, RoPE, and GQA — with the math behind every change.

36 min read · [rishi2220.hashnode.dev](https://rishi2220.hashnode.dev/towards-the-modern-transformer-architecture?utm_source=hashnode&utm_medium=feed)

[1](https://hashnode.com/posts/towards-the-modern-transformer-architecture/6a6090024093ae09cf4fb380)

[Jessen](https://hashnode.com/@jessenr) · [Apr 1, 2025](https://hashnode.com/posts/positional-encoding-from-sinusoidal-to-rope/67ec473f023f811792f69792)

### [Positional Encoding from Sinusoidal to RoPE](https://descendingnotebooks.com/positional-encoding-from-sinusoidal-to-rope?utm_source=hashnode&utm_medium=feed)

Understanding Positional Encoding: Its Purpose and Implementation Explained

16 min read · [descendingnotebooks.com](https://descendingnotebooks.com/positional-encoding-from-sinusoidal-to-rope?utm_source=hashnode&utm_medium=feed)
