Math behind backpropagation in Neural Network

Here we will discuss math behind backpropagation in neural network. Here are the prerequisites for this tutorial. Matrix, Vectors Dot product, Element-wise multiplication Matrix Calculus(Chain Rule) Gradient Descent Algorithm Let us consider a 2 l...