A caller told our voice agent to ignore its instructions, and it did. The guardrail that fixed it had a 20 millisecond budget.
Real time safety on a phone call is a latency problem before it is a safety problem, and most guardrail writeups forget that. Here is the incident, the tools I weighed, and what I shipped.
TL;DR. A ca
voicelatency.hashnode.dev16 min read