Prompt Caching for AI Agents: Stop Breaking Your Own Cache

Here's a quick audit worth running before you read further. Pull the usage object from your last hundred LLM calls and work out what fraction of input tokens came from the cache. def cache_hit_rate(us