Jan AI: Using Desktop LLMs with Langchain or llama-index
Jan allows you to deploy and run LLMs on your Windows or macOS computer! 16 Gigabytes of memory and a M1 chip was enough for me to run Mistral locally. Now how do you take Jan and use libraries like Langchain?
https://jan.ai
Local API Server
Click ...
blog.adhikary.net1 min read