blog.butter.devOn Automatic Template Induction for Response CachingAs of last week, Butter’s proxy now offers automatic template induction for its response cache! We’ve prepared the following blog post to help explain its significance and potential to help you serve more LLM responses from cache. You can also read t...Jan 7·14 min read
blog.butter.devChangelog #0006Welcome to Butter’s latest weekly changelog. Today’s log is light, as we strengthen our focus on the R&D-side of templated caching. This week, we’ve also seen some more signups, which have brought about a higher volume of requests through Butter’s pr...Nov 15, 2025·1 min read
blog.butter.devChangelog #0005Welcome to Butter’s fifth weekly changelog. This week, we’ve seen a promising amount of new signups, as well as have tightened up our onboarding and helped users check Butter’s status. Onboarding Experience Cleaned up the onboarding experience we de...Nov 8, 2025·1 min read
blog.butter.devChangelog #0004Welcome to Butter’s fourth weekly changelog. This week we celebrate our launch, with a focus on the first time onboarding experience. Better Onboarding Experience Added an onboarding flow to guide first-time users through their first cache miss and ...Nov 1, 2025·1 min read
blog.butter.devChangelog #0002Hi there! Welcome to our second weekly changelog. Performance Improvement Average cache hit response times are now 8.9x faster due to data caching on the server. Fixes Fixed a bug related to traversing cache entries with 100+ children. We’re Hiring W...Oct 18, 2025·1 min read
