@maheshmoholkar

Mahesh Moholkar

@maheshmoholkarMaharashtra, IndiaJoined April 2022

Software Engineer

Website

About

Nothing here yet.

Available for

Nothing here yet.

Mahesh Moholkar's blogs

From Scratchmaheshmoholkar.hashnode.dev5 posts

maheshmoholkar.hashnode.dev6d ago · 43 min read

Building a Modern LLM from Scratch: RMSNorm, RoPE, GQA and SwiGLU

This is the fourth part of a series on how language models work, built from the ground up. Part 1 built a neural network as an office building and trained it. Part 2 put text through the building and

maheshmoholkar.hashnode.devSep 28 · 44 min read

The Math Underneath Neural Networks: Tensors, Matrices and PyTorch

This is the third part of a series on how language models work, built from the ground up. Part 1 built a neural network as an office building and trained it with four steps on repeat. Part 2 put text

maheshmoholkar.hashnode.devSep 12 · 70 min read

Text to Attention From Scratch

This is the second part of a series on how language models work, built from the ground up. The first part covered what a neural network is made of and how it learns: an office building of workers, man

maheshmoholkar.hashnode.devSep 10 · 53 min read

Neural Networks from Scratch

I spent a long time nodding along to neural network explainers without actually understanding them. I could repeat the words — weights, backpropagation, activation function — but I couldn't have told

maheshmoholkar.hashnode.devOct 18, 2022 · 2 min read

Observability Driven Development with Sprkl

🙂 What is Observability Driven Development ? Development is kind of like an iterative process. You write some code, you make some changes and then you try to execute it. After execution you try to analyze the result and sometimes you find that it i...

Mahesh Moholkar

About

Available for

Mahesh Moholkar's blogs

Building a Modern LLM from Scratch: RMSNorm, RoPE, GQA and SwiGLU

The Math Underneath Neural Networks: Tensors, Matrices and PyTorch

Text to Attention From Scratch

Neural Networks from Scratch

Observability Driven Development with Sprkl

Search Hashnode

Mahesh Moholkar

About

Available for

Mahesh Moholkar's blogs

Building a Modern LLM from Scratch: RMSNorm, RoPE, GQA and SwiGLU

The Math Underneath Neural Networks: Tensors, Matrices and PyTorch

Text to Attention From Scratch

Neural Networks from Scratch

Observability Driven Development with Sprkl