RAG Is Read-Only Memory

Andrej Karpathy shifted how he uses LLMs. Instead of burning tokens on code generation, he's spending them compiling structured knowledge bases: markdown wikis an LLM builds, links, and maintains from raw source documents. One of his research corpora...