MVP to Mission-Critical: The Idea Behind My LLM Gateway Rewrite

Several months ago I decided to play around with my first LLM gateway prototype which I simply used LiteLLM with some benefits on top. Then I did the math to find out how far it was from the productio