@raymondtana
butter dev
Nothing here yet.
Nothing here yet.
Jan 7 · 14 min read · As of last week, Butter’s proxy now offers automatic template induction for its response cache! We’ve prepared the following blog post to help explain its significance and potential to help you serve more LLM responses from cache. You can also read t...
Join discussionNov 15, 2025 · 1 min read · Welcome to Butter’s latest weekly changelog. Today’s log is light, as we strengthen our focus on the R&D-side of templated caching. This week, we’ve also seen some more signups, which have brought about a higher volume of requests through Butter’s pr...
Join discussion
Nov 8, 2025 · 1 min read · Welcome to Butter’s fifth weekly changelog. This week, we’ve seen a promising amount of new signups, as well as have tightened up our onboarding and helped users check Butter’s status. Onboarding Experience Cleaned up the onboarding experience we de...
Join discussion
Nov 1, 2025 · 1 min read · Welcome to Butter’s fourth weekly changelog. This week we celebrate our launch, with a focus on the first time onboarding experience. Better Onboarding Experience Added an onboarding flow to guide first-time users through their first cache miss and ...
Join discussion
Oct 18, 2025 · 1 min read · Hi there! Welcome to our second weekly changelog. Performance Improvement Average cache hit response times are now 8.9x faster due to data caching on the server. Fixes Fixed a bug related to traversing cache entries with 100+ children. We’re Hiring W...
Join discussion
