---
title: "Discussion on \"Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow\" | Hashnode"
description: "Discussion on \"Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow\". How I found register spills in the main loop, fixed them, and got a 1.42x end-to-end speedup on an L4"
url: "https://hashnode.com/posts/blockwise-fp8-ada-kernel-4x-too-slow/6ad2ef38195837f31546215e"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow](https://amankarki.hashnode.dev/blockwise-fp8-ada-kernel-4x-too-slow?utm_source=hashnode&utm_medium=feed)

How I found register spills in the main loop, fixed them, and got a 1.42x end-to-end speedup on an L4

Oct 17 · 8 min read · amankarki.hashnode.dev  
Read the article

-   [#cuda](https://hashnode.com/tag/cuda)
-   [#gpu](https://hashnode.com/tag/gpu)
-   [#llm](https://hashnode.com/tag/llm)
-   [#vllm](https://hashnode.com/tag/vllm)
-   [#quantization](https://hashnode.com/tag/quantization)

## Written by

[Aman Karki](https://hashnode.com/@amankarki)

@amankarki · India

  
[View profile](https://hashnode.com/@amankarki)

C++/CUDA Engineer · LLM Inference & Systems

C++/CUDA engineer building LLM inference and GPU code from scratch: verbum.cpp, Lattice, RAAG. 2 CUDA PRs merged into llama.cpp. I write about inference, GPU performance, and measuring things honestly.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.