Rolling Out LLM Changes Without Breaking Users

Here is the incident you are going to have if you don't read this post. Your LLM provider releases a new model version. It's better on every benchmark. You flip the model name in one line of code — claude-sonnet-4-6 to claude-sonnet-4-7 — and deploy....