Paper Review; ADAM: A METHOD FOR STOCHASTIC OPTIMIZATION

The ADAM optimization algorithm is an extension of stochastic gradient descent which according to Wikipedia is an iterative method for optimizing an objective function with suitable smoothness properties. It can be regarded as a stochastic approximat...