---
title: "Discussion on \"The voice A/B test that picked the worse agent, and won by 4 points\" | Hashnode"
description: "Discussion on \"The voice A/B test that picked the worse agent, and won by 4 points\". We ran a clean A/B test between two versions of a phone agent. Variant B won by 4 points on our success metric. We shipped B. Two weeks later the escalation rate to human agents had gone up, and the \""
url: "https://hashnode.com/posts/the-voice-a-b-test-that-picked-the-worse-agent-and-won-by-4-points/6a72d0e4eb9e072263c88e55"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [The voice A/B test that picked the worse agent, and won by 4 points](https://voicelatency.hashnode.dev/the-voice-a-b-test-that-picked-the-worse-agent-and-won-by-4-points?utm_source=hashnode&utm_medium=feed)

We ran a clean A/B test between two versions of a phone agent. Variant B won by 4 points on our success metric. We shipped B. Two weeks later the escalation rate to human agents had gone up, and the "

Aug 5 · 6 min read · voicelatency.hashnode.dev  
Read the article

-   [#voiceagents](https://hashnode.com/tag/voiceagents)
-   [#abtesting](https://hashnode.com/tag/abtesting)
-   [#evaluation](https://hashnode.com/tag/evaluation)
-   [#latency](https://hashnode.com/tag/latency)

## Written by

[marcuschen](https://hashnode.com/@marcuscodes)

@marcuscodes · New York, USA

  
[View profile](https://hashnode.com/@marcuscodes)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
