Do you have any idea how ChatGPT was trained?

ChatGPT is "just" a fine-tuned GPT-3 model that requires a surprisingly small amount of data! Furthermore, InstructGPT (ChatGPT's sibling model) appears to use 1.3B parameters, whereas GPT-3 appears to use 175B parameters! It is fine-tuned first with...