From Atoms to Algorithms

How Physics Inspired Neural Networks When I first came across gradient descent, something about it felt familiar.It reminded me of a simple idea from physics — that systems tend to move toward stability.A ball rolls downhill. A stretched spring retur...