Building an Autograd Library for Neural Net in C++ from Scratch: My Journey and Lessons

Introduction Creating an Autograd library and Neural nets in C++ from scratch has been one of the most fun and challenging side projects I’ve undertaken recently. Inspired by Andrej Karpathy’s micrograd in Python, I wanted to explore the same idea in...