Week 3: Autograd and Computation Graphs

To understand autograd, it’s important to first understand two key concepts: gradients and computation graphs. Let’s go through them step-by-step. What is Gradient Descent ? Gradient descent is an optimization algorithm used to minimize a loss functi...