Kaan Berke UGURLARkaanberke.hashnode.dev·Sep 17, 2023This New Optimizer Called Lion Could Replace Adam as the Go-To for Training Neural NetsGoogle Brain researchers have discovered a new optimization algorithm for training deep neural networks called Lion that outperforms the popular Adam optimizer on a variety of computer vision and natural language processing tasks. In a paper publishe...226 readsOptimizerAdd a thoughtful commentNo comments yetBe the first to start the conversation.