Stop Parsing Strings: Structured Output From LLMs
Here's a class of bug I wrote in my first LLM app and then again, on a different team, six months later.
I wrote a feature that asked the model to classify a user's message into one of three categories — billing, technical, other — and return it as J...
