Most teams running prompt-cached LLM pipelines have no idea what their cache is actually saving them. cachebench tells you.

Most teams running prompt-cached LLM pipelines have no idea what their cache is actually saving them. Anthropic shipped the cache-control API months ago. Most pipelines still have not measured the sav