Informal Safety Guarantees for Simulated Optimizers Through Extrapolation from Partial Simulations

Self-supervised learning is the backbone of state of the art language modeling. It has been argued that training with predictive loss on a self-supervised dataset causes simulators: entities that internally represent possible configurations of real-w...