SPA good read, I think. NVIDIA is doing a lot with Dynamo, and reducing cold-start times is great. However, I think wasted compute and idle CPU resources are still open challenges.Comment·Article·46m ago·Inside NVIDIA Dynamo: A Deep Technical Tour of the Datacenter-Scale Inference Stack