How does activation initialization affect training in neural network

Initialization affect training in neural network import torch def init(): x = torch.randn(512) a = torch.randn(512, 512) return x,a x,a = init() for i in range(100): x = a @ x x.std(), x.mean() (tensor(nan), tensor(nan)) The matr...