Dave Gaunkysaltyoldgeek.hashnode.dev·May 16, 2024Setting Up an Ollama + Open-WebUI ClusterWhy? Having set up an Ollama + Open-WebUI machine in a previous post I started digging into all the customizations Open-WebUI could do, and amongst those was the ability to add multiple Ollama server nodes. This got me thinking about setting up multi...Discussollama
Hongtech.mrleong.net·May 9, 2024Self Host Llama 3 On Arch LinuxTechnology is evolving very fast. Now a person without knowledge of how AI works can easily setup and host a ChatGPT-like service on personal computer. Llama is a large language model released by Meta AI. Meta has recently released Llama 3, making it...Discuss·33 readsHow-toLlama3
Dave Gaunkysaltyoldgeek.hashnode.dev·Apr 29, 2024Setup Llama 3 using Ollama and Open-WebUITested Hardware Below is a list of hardware I've tested this setup on. In all cases things went reasonably well, the Lenovo is a little despite the RAM and I'm looking at possibly adding an eGPU in the future. Both Macs with the M1 processors run gre...Discussopen-webui
