---
title: "Kashif (@ifkash) | Hashnode"
description: "Make the computer beep boop. Read the latest articles by Kashif on Hashnode."
url: "https://hashnode.com/@ifkash"
---

@ifkash

# Kashif

@ifkash · Bengaluru, India · Joined May 2021

Make the computer beep boop.

[Website](https://ifkash.dev/)

### [Teaching Llama 3 to be Polite](https://blog.ifkash.dev/teaching-llama-3-to-be-polite?utm_source=hashnode&utm_medium=feed)

Spent ~$3 on A100 (80GB) instance on RunPod

8 min read · [blog.ifkash.dev](https://blog.ifkash.dev/teaching-llama-3-to-be-polite?utm_source=hashnode&utm_medium=feed)

[Feb 25](https://hashnode.com/posts/teaching-llama-3-to-be-polite/699f389dc9015c37f6ac5bc9)

### [I Pretrained a 360M LLaMA-Style Language Model from Scratch on 6B FineWeb Tokens (Single H100)](https://blog.ifkash.dev/smol-llama-pretraining?utm_source=hashnode&utm_medium=feed)

Explore pretraining a 360M LLaMA-style language model on 6B tokens using a single H100 GPU, with reproducible results

5 min read · [blog.ifkash.dev](https://blog.ifkash.dev/smol-llama-pretraining?utm_source=hashnode&utm_medium=feed)

[Feb 8](https://hashnode.com/posts/smol-llama-pretraining/698898652fb502a9301f0a63)

### [From Karpathy's micrograd to smoltorch: Understanding Autograd from First Principles](https://blog.ifkash.dev/smoltorch?utm_source=hashnode&utm_medium=feed)

Why I Built My Own Deep Learning Framework? After watching Andrej Karpathy’s micrograd lecture, I had a realization: I’d been using PyTorch for months, but I didn’t really understand how autograd worked. Sure, I could call .backward() and get gradien...

7 min read · [blog.ifkash.dev](https://blog.ifkash.dev/smoltorch?utm_source=hashnode&utm_medium=feed)

[Nov 18, 2025](https://hashnode.com/posts/smoltorch/691c9c514bdcbebd9e442027)

### [I Built a Tiny Vector Database (and Pointed It at FAISS)](https://blog.ifkash.dev/tiny-vector-db?utm_source=hashnode&utm_medium=feed)

Vector DBs are everywhere these days: Pinecone, Weaviate, Qdrant, Chroma, FAISS … you name it! Most of them are full-featured systems with servers, APIs, dashboards, the works. Sometimes the best way to demystify hype is to build it yourself. Here’s ...

4 min read · [blog.ifkash.dev](https://blog.ifkash.dev/tiny-vector-db?utm_source=hashnode&utm_medium=feed)

[Aug 28, 2025](https://hashnode.com/posts/tiny-vector-db/68b09e28102457e90d5c6027)

### [The instability of a softmax function](https://blog.ifkash.dev/instability-of-a-softmax-function?utm_source=hashnode&utm_medium=feed)

Explains the numerical instability of the softmax function and how to fix it using vector transformations

2 min read · [blog.ifkash.dev](https://blog.ifkash.dev/instability-of-a-softmax-function?utm_source=hashnode&utm_medium=feed)

[Mar 5, 2025](https://hashnode.com/posts/instability-of-a-softmax-function/67c88a83155e3cf83a2fcb50)
