How Neural Networks Learned to Remember — RNNs, LSTMs, and GRUs

It’s an afternoon of a beautiful summer day. You just learnt about backpropagation, gradients and artificial neural networks and you think you’ve unlocked some forbidden treasure of knowledge granted