Search posts, tags, users, and pages
Cache-aware routing, prefill/decode disaggregation and autoscaling compared, and how to choose per model pool
Shubham Tatvamasi
@ShubhamTatvamasi
AI infrastructure engineer. Inference, GPUs and GitOps on Kubernetes.
Markdown supported · ⌘↵ to post
No responses yet.