Comparing Open Source LLM Gateways
If you're running multiple LLM providers and want a single API in front of them, you have options. This post compares open source LLM gateways, including our own OpenZiti llm-gateway. We'll try to be
blog.openziti.io6 min read
Rick Crawford
Developer advocate
One area to consider is the supply chain of the proxies. I am wary to use LiteLLM given its dependency tree.