@nishanthan

Nishanthan Karunakaran

@nishanthanJoined July 2024

An Software Engineer who loves to build end to end working products

About

Nothing here yet.

Available for

Nothing here yet.

Nishanthan Karunakaran's blogs

Nishanthan's blognishanthan.hashnode.dev7 posts

Core Elements of Large Language Models (LLMs): Tokens, Context Windows, Temperature, and Sampling

Large Language Models (LLMs) have become a fundamental part of modern AI applications, powering everything from conversational chatbots to code generation and intelligent assistants. While their capab

3d ago · 6 min readnishanthan.hashnode.dev

How Query, Key, and Value (QKV) Work in Transformers

Every Transformer-based language model, from BERT to GPT, relies on a mechanism called attention to determine how different tokens in a sequence relate to one another. At the heart of this mechanism a

Oct 22 · 7 min readnishanthan.hashnode.dev

Understanding Transformer: The Architecture Behind Modern AI

What Is a Transformer? A Transformer is a neural network architecture introduced by Google researchers in 2017 in the paper Attention Is All You Need. It uses attention mechanisms to help the model le

Oct 15 · 6 min readnishanthan.hashnode.dev

Activation Functions in Neural Networks — A Practical Mental Model

Introduction Activation functions decide how a neuron responds to an input signal. They introduce non-linearity, enabling neural networks to learn complex patterns. This article focuses on the most commonly used activation functions: Sigmoid Sof...

Dec 22, 2025 · 4 min readnishanthan.hashnode.dev

Backpropagation in Deep Learning: A Complete, Intuitive, and Practical Guide

Introduction: Why Backpropagation Matters Backpropagation is the learning engine behind modern deep learning. Every time a neural network improves its predictions — from recognizing faces to generating text — the improvement comes from one mechanism:...

Dec 17, 2025 · 6 min readnishanthan.hashnode.dev

Nishanthan Karunakaran

About

Available for

Nishanthan Karunakaran's blogs

Core Elements of Large Language Models (LLMs): Tokens, Context Windows, Temperature, and Sampling

How Query, Key, and Value (QKV) Work in Transformers

Understanding Transformer: The Architecture Behind Modern AI

Activation Functions in Neural Networks — A Practical Mental Model

Backpropagation in Deep Learning: A Complete, Intuitive, and Practical Guide

Search Hashnode

Nishanthan Karunakaran

About

Available for

Nishanthan Karunakaran's blogs

Core Elements of Large Language Models (LLMs): Tokens, Context Windows, Temperature, and Sampling

How Query, Key, and Value (QKV) Work in Transformers

Understanding Transformer: The Architecture Behind Modern AI

Activation Functions in Neural Networks — A Practical Mental Model

Backpropagation in Deep Learning: A Complete, Intuitive, and Practical Guide