---
title: "K. L. Aadithya (@ash-grey) | Hashnode"
description: "K. L. Aadithya (@ash-grey) writes on Hashnode. Read their latest articles and follow their work."
url: "https://hashnode.com/@ash-grey"
---

@ash-grey

# K. L. Aadithya

@ash-grey · Joined November 2026

### [How I Built an LLM Inference Engine From Scratch in CUDA (235 tokens/s on a 6 GB Laptop GPU)](https://aadithya.hashnode.dev/how-i-built-an-llm-inference-engine-from-scratch-in-cuda-235-tokens-s-on-a-6-gb-laptop-gpu?utm_source=hashnode&utm_medium=feed)

I built tinyinfer, an open-source LLM inference engine in C++/CUDA with no PyTorch or cuBLAS. It runs TinyLlama at 235 tokens/s on a 6 GB RTX 3050 laptop GPU.

11 min read · [aadithya.hashnode.dev](https://aadithya.hashnode.dev/how-i-built-an-llm-inference-engine-from-scratch-in-cuda-235-tokens-s-on-a-6-gb-laptop-gpu?utm_source=hashnode&utm_medium=feed)

[4d ago](https://hashnode.com/posts/how-i-built-an-llm-inference-engine-from-scratch-in-cuda-235-tokens-s-on-a-6-gb-laptop-gpu/6af8ac25576765a570c8a730)
