Search posts, tags, users, and pages
ResKV adds a residual cache to eviction-based KV compression, restoring dropped tokens' softmax mass. No extra memory. LongBench 32/32, RULER 63/64.
Chaeyeon Mia Lee
@miainflorence · Seoul, South Korea
Markdown supported · ⌘↵ to post
No responses yet.