Search posts, tags, users, and pages
One OpenAI-compatible endpoint, model-aware routing, GPU-aware scheduling, and scaling driven by inference pressure, not CPU
Shubham Tatvamasi
@ShubhamTatvamasi
AI infrastructure engineer. Inference, GPUs and GitOps on Kubernetes.
Markdown supported · ⌘↵ to post
No responses yet.