I Trained a Language Model From Scratch on a 4 GB GPUA 4 GB GPU, a small corpus and a lot of things that went wrong in instructive ways. I trained a 22-million-parameter language model from scratch on a laptop with 4 GB of VRAM. It learned to imitate teOct 12 · 7 min readsandrabamboo.hashnode.dev