---
title: "Comment by Rose Alvina on \"Why typed decisions?\" | Hashnode"
description: "Nice framing of act / clarify / hand off as the real output. A practical note for anyone applying this to a support bot: pick the two thresholds from costs rath"
url: "https://hashnode.com/posts/why-typed-decisions/6ad2ac5aa305ffe6691817a4/comment/6ad2ff3c3a18711331186aa7"
---

[Discussion](https://hashnode.com/posts/why-typed-decisions/6ad2ac5aa305ffe6691817a4)

Comment [Why typed decisions?](https://hashnode.com/posts/why-typed-decisions/6ad2ac5aa305ffe6691817a4)

[Rose Alvina](https://hashnode.com/@rosealvinanex)

[Oct 17](https://hashnode.com/posts/why-typed-decisions/6ad2ac5aa305ffe6691817a4/comment/6ad2ff3c3a18711331186aa7)

Nice framing of act / clarify / hand off as the real output. A practical note for anyone applying this to a support bot: pick the two thresholds from costs rather than accuracy. Estimate what a wrong automatic action costs versus a clarifying question versus a human handoff, then choose the act and hand-off cutoffs on a held-out set that minimise total expected cost. That usually lands you on a high "act" threshold and a surprisingly wide "clarify" band. Also watch calibration drift: track the share of traffic in each band per week. If the "act" share drops suddenly, new intents or wording have appeared, and that is the moment to label a fresh batch and refit, which as you note takes seconds. Finally, when an intent's top two labels are close in probability, a clarifying question that names both options tends to resolve it in one turn.

[Limin Ma](https://hashnode.com/@liminma)

[1d ago](https://hashnode.com/posts/why-typed-decisions/6ad2ac5aa305ffe6691817a4/comment/6ad2ff3c3a18711331186aa7#reply-6af631fe0c601f44a67f392c)

Thanks for the practical notes. [Post 8](https://liminma.hashnode.dev/from-confidence-to-action) starts from the same three costs but turns them into two targets instead: actions should be right at least 98% of the time, and questions should offer the right intent at least 90% of the time. The result is what you predicted, with a high act threshold and 39.9% of test messages in the ask band. Minimizing expected cost directly is cleaner when a team can say roughly how the outcomes compare.

Tracking weekly band shares is a nice addition. The post only suggests checking how often actions are right, which needs labels. Band shares don't, so they can flag drift sooner.

On your last point: your tip on close pairs fills a gap in the post. When two intents are close, the confidence is at most about 0.5 and often lower. Many of these answers fall below the ask threshold of 0.493 and go to a human agent. Your rule would offer them the two options instead. I haven't tested it, so I can't say how many answers it would catch.
