A Benchmark Log That Keeps LLM Gateway Retries Honest

If you benchmark an LLM gateway, make the logical request your unit of user-visible success and keep a separate record for every attempt beneath it. That one modeling choice prevents a retry from disa