Why Tokens Per Joule Matters More Than Tokens Per Second

Apr 16 · 8 min read · Most GPU benchmarks report tokens/sec, but that metric ignores the dominant driver of real-world inference cost: energy. I built a cross-platform telemetry suite to measure Tokens Per Joule (T/J) — to