Jay Gala

@Jaygala223

Website

AI Software Engineer at Intel

Mumbai, IndiaJoined December 2022

About

Currently working as an AI Software Engineer at Intel

Available for

Reach out to me on Linkedin or email me at jaygala260@gmail.com

Jay Gala's blogs

Gala codesgalacodes.hashnode.dev15 posts

Articles Comments2

Recently published

JGJay Galagalacodes.hashnode.dev6d ago · 15 min read

I Wrote a GPU Matmul Kernel From Scratch in Triton. Here's Everything I Learned

I recently started learning Triton, OpenAI's Python-based language for writing GPU kernels. My project: build a matrix multiplication kernel from scratch, step by step, until it's competitive with PyT

0

JGJay Galagalacodes.hashnode.devNov 30, 2025 · 18 min read

GPUs: The Hardware That Power AI

You've probably used ChatGPT or Claude. Maybe you've even fine-tuned a small language model on your laptop. But have you ever wondered why training or even inferencing GPT or Claude requires tens of thousands of specialized chips aka GPUs instead of ...

0

JGJay Galagalacodes.hashnode.devNov 5, 2025 · 15 min read

Speculative Decoding: From Theory to Implementation

Let's talk about speculative decoding. One of the most elegant optimization techniques in modern LLM inference. If you've ever wondered how to squeeze 2-3x more throughput from your language models without sacrificing output quality, you're in the ri...

1

B

JGJay Galagalacodes.hashnode.devMay 30, 2025 · 6 min read

Bits Don't Lie: Datatypes in Modern LLMs

Let’s talk about the different datatypes that are being used in modern LLMs like GPT, LLaMa and the like. The most common ones that you might have heard: FP32, BFloat16, Float16, INT8, etc. These are all standard data types and available in PyTorch a...

0

JGJay Galagalacodes.hashnode.devOct 26, 2024 · 7 min read

Introduction to LLM inferencing

Unless you’re living under a rock, you’ve probably heard of Large Language Models (LLMs) and even used a few of the popular applications like ChatGPT, Claude, Perplexity, etc. powered by these LLMs. So without going too deep into what LLMs are, let’s...

0

Jay Gala

About

Available for

Jay Gala's blogs

Recently published

I Wrote a GPU Matmul Kernel From Scratch in Triton. Here's Everything I Learned

GPUs: The Hardware That Power AI

Speculative Decoding: From Theory to Implementation

Bits Don't Lie: Datatypes in Modern LLMs

Introduction to LLM inferencing

Search Hashnode

Jay Gala

About

Available for

Jay Gala's blogs

Recently published

I Wrote a GPU Matmul Kernel From Scratch in Triton. Here's Everything I Learned

GPUs: The Hardware That Power AI

Speculative Decoding: From Theory to Implementation

Bits Don't Lie: Datatypes in Modern LLMs

Introduction to LLM inferencing