Stephane BersierforConversations with AIaiconversations.hashnode.dev·Nov 1, 2024Reparametrization sensitivity, with ChatGPTThe conversation has been condensed and edited for clarity. User: One issue with vanilla gradient descent is that the gradient direction is sensitive to parametrization. Are there practical methods to avoid this issue? Does natural gradient descent h...DiscussNatural Gradient Descent
