Tag feed

#ai-gateway

23 posts0 followers

Explore Hashnode

Alternatives

Trending tags this week

NFNicolas Fränkelfrankel.hashnode.devJun 4 · 9 min read

AI gateways: why and how

Before working for 2 years on the Apache APISIX API gateway, I was mainly oblivious to API gateways. It's only by working with them that I understood their value. Decoupling the client and the server

0

KEKarim El Jamalijamali.hashnode.devMay 17 · 10 min read

Gateway API Inference Extensions: An AI Aware Load Balancer

Introduction If you’ve been anywhere near the Kubernetes ecosystem lately, you’ve probably heard the buzz around Gateway API — and the ongoing “Ingress is going away” narrative. I’ve covered Gateway A

0

AAzureEngBRazure-tech.hashnode.devMay 4 · 2 min read

Centralised AI Model Management with Azure Foundry AI Model Gateway Connections

Microsoft Azure now offers a capability to link an Azure Foundry project to another via an AI Gateway.This provides a pattern with which AI models can be centralised and then shared with governance an

0

NBNishil Bhavenishilbhave.hashnode.devMay 4 · 17 min read

AI Gateway Architecture: 7 Cross-Cutting Concerns (2026)

Inside an AI Gateway: 7 Cross-Cutting Concerns That Don't Belong in Your App Code Pull up the source of any production AI feature shipped in 2026 and you'll find the same mess. An OpenAI client wrapped in a try/except. A hardcoded retry. An if model ...

0

JKJangwook Kimeffloow.hashnode.devApr 21 · 12 min read

OpenClaw: Self-Hosted AI Gateway for WhatsApp, Telegram & Discord

## Why OpenClaw Has 250,000 GitHub Stars in Four Months In late January 2026, a project called OpenClaw crossed 100,000 GitHub stars in under two weeks. By March 3, 2026, it had surpassed React's decade-long record of 243,000 stars, claiming the tit...

0

DGDeepak Grewaldeepinkong.hashnode.devMar 13 · 10 min read

Adding Non-English PII Detection to Kong AI Sanitizer

kong ai-gateway ai-sanitizer pii presidio spacy eu-ai-act security Kong's AI Sanitizer plugin detects and redacts PII before it reaches your LLM. It ships with pre-built container images for 9 languag

2

DA

TPTao Puputao282.comFeb 4 · 5 min read

Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing

# Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing Recently, while developing [llm-converter](https://github.com/putao520/llm-converter)—a Rust library for LLM protocol conversion—I encountered a problem: **h...

0

TPTao Puputao282.comFeb 4 · 15 min read

Building an AI Inference Gateway: Practice and Insights

# Building an AI Inference Gateway: Practice and Insights Recently, while building an AI inference gateway, I encountered quite a few challenges. AI gateways differ significantly from traditional API gateways: request bodies can be tens of KB, infer...

0

SSSuraj Somaniblog.surajsomani.comJan 29 · 6 min read

Azure APIM AI Gateway: LLM Token Consumption Governance and Monitoring

The fast-evolving AI landscape requires organizations to adopt experimentation-driven approaches to stay competitive. As AI transforms industries, rapid innovation is key. Since AI services are largely accessed through APIs, a strong API management s...

0

DGDeepak Grewaldeepinkong.hashnode.devJan 18 · 11 min read

MCP Tool Governance: Security Meets Context Efficiency

kong kong-3.13 mcp ai-agents ai-gateway security TL;DR MCP servers expose all tools by default. Two problems: Security: Agents get capabilities they shouldn't have Performance: Too many tools degrade LLM tool selection Solution: Put a gateway betwe...

0

#ai-gateway

Search Hashnode

#ai-gateway

Explore Hashnode

Trending tags this week

AI gateways: why and how

Gateway API Inference Extensions: An AI Aware Load Balancer

Centralised AI Model Management with Azure Foundry AI Model Gateway Connections

AI Gateway Architecture: 7 Cross-Cutting Concerns (2026)

OpenClaw: Self-Hosted AI Gateway for WhatsApp, Telegram & Discord

Adding Non-English PII Detection to Kong AI Sanitizer

Building an AI Inference Gateway, Part 2: Unifying Streaming and Non-Streaming Processing

Building an AI Inference Gateway: Practice and Insights

Azure APIM AI Gateway: LLM Token Consumption Governance and Monitoring

MCP Tool Governance: Security Meets Context Efficiency