LLM Cost Optimization: How We Cut Reply Generation from $0.011 to $0.0009

When we shipped the first version of AI-generated replies for HelperX, each reply cost us about \(0.011 in API spend. That sounds tiny until you multiply by 30 replies per slot per day times 200 activ