---
title: "Terry Tao (@taot) | Hashnode"
description: "Terry Tao (@taot) writes on Hashnode. Read their latest articles and follow their work."
url: "https://hashnode.com/@taot"
---

@taot

# Terry Tao

@taot · Joined January 2026

### [Grokking of Transformer on Modular Addition](https://taot.hashnode.dev/grokking-of-transformer-on-modular-addition?utm_source=hashnode&utm_medium=feed)

Background Grokking is a phenomenon where a model quickly achieves near-perfect training accuracy (memorization), while validation accuracy remains near chance for a long time, and then later transitions sharply to strong generalization after extende...

3 min read · [taot.hashnode.dev](https://taot.hashnode.dev/grokking-of-transformer-on-modular-addition?utm_source=hashnode&utm_medium=feed)

[Feb 8](https://hashnode.com/posts/grokking-of-transformer-on-modular-addition/69891e062bb00818234f0baa)

### [Grokking of MLP on Modular Addition](https://taot.hashnode.dev/grokking-of-mlp-on-modular-addition?utm_source=hashnode&utm_medium=feed)

Background Grokking is a phenomenon where a model quickly achieves near-perfect training accuracy (memorization), while validation accuracy remains near chance (or even worse-than-chance) for a long time, and then later transitions sharply to strong ...

4 min read · [taot.hashnode.dev](https://taot.hashnode.dev/grokking-of-mlp-on-modular-addition?utm_source=hashnode&utm_medium=feed)

[Jan 24](https://hashnode.com/posts/grokking-of-mlp-on-modular-addition/69751862c6c0290f8faee595)
