How to Set Up a Local LLM for APEX 24.1

First, you need something to serve the OpenAI API using a local model. I use ollama as it simply works and it’s very easy to set up and update. Ollama as an OpenAI API provider Download Ollama on Linux Install ollama: curl -fsSL https://ollama.com/in...