From 2.44 s to 1.81 s: working through my voice agent's latency list, and the fast model that went silent
TL;DR
Part 1 ended with a list of things to try. I tried all of them on the same phone agent, now running a recruiter's pre-screening call.
At the agent, the median reply went from 2.44 s to 1.81 s
mohammed-usmani.hashnode.dev11 min read