---
title: "Comment by Rajesh Killadi on \"RAG vs CAG: The Future of Dynamic Knowledge in LLMs\" | Hashnode"
description: "I feel like you should've also talked about the new problems CAG brings in. I think it needs way more working memory to hold that cache compared to a RAG setup,"
url: "https://hashnode.com/posts/rag-vs-cag-the-future-of-dynamic-knowledge-in-llms/6a4faaad929e331e4ea37bfe/comment/6a505e2c1525c3e7b17555b7"
---

[Discussion](https://hashnode.com/posts/rag-vs-cag-the-future-of-dynamic-knowledge-in-llms/6a4faaad929e331e4ea37bfe)

Comment [RAG vs CAG: The Future of Dynamic Knowledge in LLMs](https://hashnode.com/posts/rag-vs-cag-the-future-of-dynamic-knowledge-in-llms/6a4faaad929e331e4ea37bfe)

[Rajesh Killadi](https://hashnode.com/@rajesh_killadi)

[Jul 10](https://hashnode.com/posts/rag-vs-cag-the-future-of-dynamic-knowledge-in-llms/6a4faaad929e331e4ea37bfe/comment/6a505e2c1525c3e7b17555b7)

I feel like you should've also talked about the new problems CAG brings in. I think it needs way more working memory to hold that cache compared to a RAG setup, since you're basically keeping everything loaded instead of just pulling small chunks when needed.

[Chiranjeevi R](https://hashnode.com/@chiranjeevi7777)

[Jul 10](https://hashnode.com/posts/rag-vs-cag-the-future-of-dynamic-knowledge-in-llms/6a4faaad929e331e4ea37bfe/comment/6a505e2c1525c3e7b17555b7#reply-6a50fce9a95c30283379278c)

That's a good point, and I agree. CAG definitely introduces its own trade-offs, especially around memory usage and context limits since the relevant knowledge needs to stay loaded in the model's context.

From what I've learned, CAG works best in scenarios where the knowledge base is relatively static or changes infrequently—for example, company policies, product documentation, or internal manuals. In those cases, loading the information once and reusing it can be simpler than maintaining a full RAG pipeline.

For larger or frequently changing datasets, RAG is still the better choice because it retrieves only the relevant chunks instead of keeping everything in memory.

I appreciate you pointing this out—I'll update the article to include the trade-offs of CAG so readers get a more balanced comparison.