How much money it takes to train an LLM ?

GPT-1 was trained at a negligible cost. GPT-2, on the other hand, cost $40,000 to train, a sum generally beyond what a hobbyist programmer might be able to afford. However, GPT-3 took over $100 million to train, which is nearly 100 times larger than ...