---
title: "Discussion on \"H2O KV Cache - An Easy Explanation\" | Hashnode"
description: "Discussion on \"H2O KV Cache - An Easy Explanation\". Heavy Hitter Oracle, the basic idea behind it is that, it retains the tokens which have better attention and evicts the tokens which don't, it also keeps the recent tokens in cache and that is how it"
url: "https://hashnode.com/posts/h2o-kv-cache-an-easy-explanation/6a8fe99d91eff7f8c1b56dcc"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [H2O KV Cache - An Easy Explanation](https://tech.peculiarvivek.com/h2o-kv-cache-an-easy-explanation?utm_source=hashnode&utm_medium=feed)

Heavy Hitter Oracle, the basic idea behind it is that, it retains the tokens which have better attention and evicts the tokens which don't, it also keeps the recent tokens in cache and that is how it

Aug 27 · 5 min read · tech.peculiarvivek.com  
Read the article

## Written by

[Vivek Khatri](https://hashnode.com/@peculiarvivek)

@peculiarvivek · India

  
[View profile](https://hashnode.com/@peculiarvivek)

Refactoring code, one repo at a time.

I am still deciding what should I write here.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
