Observability for AI Apps: What to Log When Your Product Is a Black Box

It's 2am and a support ticket comes in: "the AI gave a completely wrong answer and then it took forever." You open your logs to figure out what happened. You see a POST /chat request. You see a 200 OK