ReLU activation

In the previous article, we discussed activation functions, which are functions used for computation in each neuron in a layer. In this article, we will be talking about a common activation function called ReLU (Rectified Linear Unit). ReLU is 0 if ...