---
title: "Discussion on \"KV Cache and Prompt Caching: How to Leverage them to Cut Time and Costs\" | Hashnode"
description: "Discussion on \"KV Cache and Prompt Caching: How to Leverage them to Cut Time and Costs\". Learn how KV caching and prompt caching optimize LLM inference, reducing time and costs while balancing the challenge of increased memory consumption"
url: "https://hashnode.com/posts/kv-cache-and-prompt-caching-how-to-leverage-them-to-cut-time-and-costs/696a0290c49db289c77da82c"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [KV Cache and Prompt Caching: How to Leverage them to Cut Time and Costs](https://sjun.hashnode.dev/kv-cache-and-prompt-caching-how-to-leverage-them-to-cut-time-and-costs?utm_source=hashnode&utm_medium=feed)

Learn how KV caching and prompt caching optimize LLM inference, reducing time and costs while balancing the challenge of increased memory consumption

Jan 16 · 10 min read · sjun.hashnode.dev  
Read the article

-   [#llm](https://hashnode.com/tag/llm)
-   [#machinelearning](https://hashnode.com/tag/machinelearning)
-   [#generative-ai](https://hashnode.com/tag/generative-ai)
-   [#optimization](https://hashnode.com/tag/optimization)

## Written by

[Jun Bae](https://hashnode.com/@jun07)

@jun07

  
[View profile](https://hashnode.com/@jun07)

Developer

## Responses

Comments are turned off for this post.
