---
title: "#grokking articles | Hashnode"
description: "Explore 3 articles tagged #grokking on Hashnode. Tutorials, guides, and how-tos from the community."
url: "https://hashnode.com/tag/grokking"
---

Tag

# #grokking

3 posts · 0 followers

[Terry Tao](https://hashnode.com/@taot) · [Feb 8](https://hashnode.com/posts/grokking-of-transformer-on-modular-addition/69891e062bb00818234f0baa)

### [Grokking of Transformer on Modular Addition](https://taot.hashnode.dev/grokking-of-transformer-on-modular-addition?utm_source=hashnode&utm_medium=feed)

Background Grokking is a phenomenon where a model quickly achieves near-perfect training accuracy (memorization), while validation accuracy remains near chance for a long time, and then later transitions sharply to strong generalization after extende...

3 min read · [taot.hashnode.dev](https://taot.hashnode.dev/grokking-of-transformer-on-modular-addition?utm_source=hashnode&utm_medium=feed)

[Terry Tao](https://hashnode.com/@taot) · [Jan 24](https://hashnode.com/posts/grokking-of-mlp-on-modular-addition/69751862c6c0290f8faee595)

### [Grokking of MLP on Modular Addition](https://taot.hashnode.dev/grokking-of-mlp-on-modular-addition?utm_source=hashnode&utm_medium=feed)

Background Grokking is a phenomenon where a model quickly achieves near-perfect training accuracy (memorization), while validation accuracy remains near chance (or even worse-than-chance) for a long time, and then later transitions sharply to strong ...

4 min read · [taot.hashnode.dev](https://taot.hashnode.dev/grokking-of-mlp-on-modular-addition?utm_source=hashnode&utm_medium=feed)

[Code Sky](https://hashnode.com/@cloudherosachin) · [Nov 6, 2025](https://hashnode.com/posts/inside-the-mind-of-machines-induction-heads-grokking-and-memorization/690c85508d93bf3ee3814305)

### [Inside the Mind of Machines: Induction Heads, Grokking, and Memorization](https://codesky.cloudhero.in/inside-the-mind-of-machines-induction-heads-grokking-and-memorization?utm_source=hashnode&utm_medium=feed)

Imagine a student sitting in a classroom. At first, he memorizes facts without truly understanding them — repeating history dates, formulas, or definitions. But then, one day, something clicks. He suddenly sees patterns — how one idea connects to ano...

4 min read · [codesky.cloudhero.in](https://codesky.cloudhero.in/inside-the-mind-of-machines-induction-heads-grokking-and-memorization?utm_source=hashnode&utm_medium=feed)
