Debugging confidently wrong answers from LLM-powered features

The bug that took two weeks to surface A few months back I shipped a feature that used a language model to summarize support tickets and suggest responses. Internal QA loved it. The demo went great. Two weeks after launch, our support lead pinged me ...