Replicating some of the success Phi-1.5 with NanoPhi

When I started the NanoPhi project, I had clear goals Using Phi-like data, textbooks Using a Model in the 300-400m parameter range Testing whether Censorship really affected a model For My model, I chose GPT-2 Medium, a 350m Parameter model, whi...