Stephane BersierforConversations with AIaiconversations.hashnode.devยทNov 1, 2024Reparametrization sensitivity, with ChatGPTThe conversation has been condensed and edited for clarity. User: One issue with vanilla gradient descent is that the gradient direction is sensitive to parametrization. Are there practical methods to avoid this issue? Does natural gradient descent h...Natural Gradient DescentAdd a thoughtful commentNo comments yetBe the first to start the conversation.
