WTH is Gradient descent?

In simpler terms, gradient descent is a method of finding the (global minimum) minimum value of a function (in the context of Neural networks, it is the Cost Function) by taking small steps in the direction of the steepest slope of the function. It i...