NnRouter.ai·Oct 15The ai-proxy Translation Table: Five Kong Plugins, Five Different HomesThe most useful page in any gateway evaluation is the translation table: not what each product has, but where each job you currently run goes. For teams on Kong, the jobs live in the plugin chain hang3 min read·nrouter.hashnode.dev
MMomin Aziz·Aug 29Enterprise AI Observability & Optimization (Part 3): Cost Optimization & Security GovernanceCut token spend using active context compression, enforce local DLP secret masking, secure provider keys via LLM Gateway, and self-host on-prem.4 min read·reclaimllm.hashnode.dev
LLearn with HJ·Jul 11AI Gateways: One Door for Models, Costs, Logs, and SanityExplain routing, fallbacks, caching, rate limits, logging, and governance.6 min read·hardeepjethwani.hashnode.dev
OOrhun Küpeli·Jun 21The Numbers: Benchmarking My LLM Gateway on a H100Real H100 benchmark of a production LLM gateway vs a naive HuggingFace baseline continuous batching, streaming TTFT, graceful 429s.5 min read·orhunkupeli.hashnode.dev1
AAshutosh Rath·May 26Launching LLM Gateway: Building a Control Plane for LLM Reliabilityllm-gateway is a thin control plane that centralizes routing, validation, fallbacks, tracing, and observability for reliable LLM features.7 min read·ashublog.hashnode.dev
OOrhun Küpeli·May 14MVP to Mission-Critical: The Idea Behind My LLM Gateway RewriteHow I rebuilt my LLM gateway from MVP to production: multi-tenant isolation, vLLM inference, budgets, and sub-5ms overhead. Architecture deep dive5 min read·orhunkupeli.hashnode.dev1
JJangwook Kim·Apr 16LiteLLM: One Proxy for 140+ LLMs — Setup & Cost GuideWhy Every Production AI Team Needs an LLM Gateway Enterprise spending on LLM APIs surpassed $8.4 billion in 2026. The teams burning the most aren't the ones with the largest models — they're the ones without a routing layer between their code and the...10 min read·effloow.hashnode.dev
SSylvester Das·Mar 30Build a Real-Time Medical Transcription Analysis App with AssemblyAI and LLM GatewayLearn to build a real-time medical transcription analysis app using AssemblyAI for accurate speech-to-text and an LLM Gateway for intelligent, compliant processing of sensitive medical data.4 min read·blog.minifyn.com