I would recommend all machine learning enthusiasts to go through this: in-depth blog over Gradient descent , which should give more clarity over the concepts you know and beyond , happy learning 😊