NeuralUCB Router: An OpenAI-Compatible API Proxy That Routes LLM Requests Using a Multi-Armed Bandit Algorithm

Every team using LLMs in production hits the same wall: you don't need GPT-4 for every request, but you don't know in advance which ones actually need it. A user asking "what is 2+2?" and a user askin