Jeff's 0.8B decision models claim ~30 ms, trained at home

Originally published at vinpatel.com ~30 ms. That is the latency in the title of Jeff, a GitHub repo of 0.8B "decision models" trained at home. Small models are no longer just shrunk. They are being b