How we implemented canary releases in kafka without breaking production

The Problem: "Move Fast, But Don’t Break Things" Our team needed a way to: Test new code safely (without impacting all users). Limit failures to a small subset of traffic. Roll back instantly if so