Pujun Lun

Thanks for reading! I like your suggestion to measure routing regret by predicted-length bucket, since it connects prediction errors to their actual decision cost. This article uses given output lengths to build intuition, while a runtime must decide before the final length is known. I’d also considered length prediction as a scheduling signal and am exploring approaches such as ELIS. Your suggestion gives me a concrete way to evaluate that next step.