Abed Kaabidkarim.hashnode.dev·Jan 7, 2025The Kaiming initialization and Batch Normalization in Neural NetworksIn my last blog post, we discussed and solved through code, how to initialize the hidden layer in neural network properly, to get rid of dead neurons. We came up with some magic numbers, randomly, as well as, by looking at the mathematics of tanh act...The Kaiming initialization
