---
title: "Discussion on \"From Karpathy's micrograd to smoltorch: Understanding Autograd from First Principles\" | Hashnode"
description: "Discussion on \"From Karpathy's micrograd to smoltorch: Understanding Autograd from First Principles\". Why I Built My Own Deep Learning Framework?\nAfter watching Andrej Karpathy’s micrograd lecture, I had a realization: I’d been using PyTorch for months, but I didn’t really understand how autograd worked. Sure, I could call .backward() and get gradien..."
url: "https://hashnode.com/posts/smoltorch/691c9c514bdcbebd9e442027"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [From Karpathy's micrograd to smoltorch: Understanding Autograd from First Principles](https://blog.ifkash.dev/smoltorch?utm_source=hashnode&utm_medium=feed)

Why I Built My Own Deep Learning Framework? After watching Andrej Karpathy’s micrograd lecture, I had a realization: I’d been using PyTorch for months, but I didn’t really understand how autograd worked. Sure, I could call .backward() and get gradien...

Nov 18, 2025 · 7 min read · blog.ifkash.dev  
Read the article

-   [#micrograd](https://hashnode.com/tag/micrograd)
-   [#pytorch](https://hashnode.com/tag/pytorch)
-   [#autograd](https://hashnode.com/tag/autograd)
-   [#deep-learning](https://hashnode.com/tag/deep-learning)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)

## Written by

[Kashif](https://hashnode.com/@ifkash)

@ifkash · Bengaluru, India

  
[View profile](https://hashnode.com/@ifkash)

Make the computer beep boop.

ML Engineer at wand.ai

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
