RTRaymond Tanainblog.butter.dev·Jan 7 · 14 min readOn Automatic Template Induction for Response CachingAs of last week, Butter’s proxy now offers automatic template induction for its response cache! We’ve prepared the following blog post to help explain its significance and potential to help you serve more LLM responses from cache. You can also read t...00
RTRaymond Tanainblog.butter.dev·Nov 15, 2025 · 1 min readChangelog #0006Welcome to Butter’s latest weekly changelog. Today’s log is light, as we strengthen our focus on the R&D-side of templated caching. This week, we’ve also seen some more signups, which have brought about a higher volume of requests through Butter’s pr...00
RTRaymond Tanainblog.butter.dev·Nov 8, 2025 · 1 min readChangelog #0005Welcome to Butter’s fifth weekly changelog. This week, we’ve seen a promising amount of new signups, as well as have tightened up our onboarding and helped users check Butter’s status. Onboarding Experience Cleaned up the onboarding experience we de...00
RTRaymond Tanainblog.butter.dev·Nov 1, 2025 · 1 min readChangelog #0004Welcome to Butter’s fourth weekly changelog. This week we celebrate our launch, with a focus on the first time onboarding experience. Better Onboarding Experience Added an onboarding flow to guide first-time users through their first cache miss and ...00
RTRaymond Tanainblog.butter.dev·Oct 18, 2025 · 1 min readChangelog #0002Hi there! Welcome to our second weekly changelog. Performance Improvement Average cache hit response times are now 8.9x faster due to data caching on the server. Fixes Fixed a bug related to traversing cache entries with 100+ children. We’re Hiring W...00
