Julien.cloudhashnode.julien.cloud·Jul 25, 2024Boost Your AI Workflow: A Guide to Using Ollama, OpenwebUI, and ContinueIn a previous article, I discussed how I used Fabric with a local Large Language Model (LLM) to enhance AI prompts and perform tasks like summarizing text, writing Merge Requests, and creating agile user stories. In this article, we will continue thi...Discuss·151 readsAI
Dave Gaunkysaltyoldgeek.hashnode.dev·Jul 8, 2024Round Two: Enhancing the Ollama ClusterRe-cap Just over three weeks ago I wrote a post titled: Setting Up an Ollama + Open-WebUI Cluster, where I went over my first experiment in creating a entry barrier node for what was to become an Ollama cluster. In short, I could see the card but per...Discussollama
Dave Gaunkysaltyoldgeek.hashnode.dev·May 16, 2024Setting Up an Ollama + Open-WebUI ClusterWhy? Having set up an Ollama + Open-WebUI machine in a previous post I started digging into all the customizations Open-WebUI could do, and amongst those was the ability to add multiple Ollama server nodes. This got me thinking about setting up multi...Discussollama
Hongtech.mrleong.net·May 9, 2024Self Host Llama 3 On Arch LinuxTechnology is evolving very fast. Now a person without knowledge of how AI works can easily setup and host a ChatGPT-like service on personal computer. Llama is a large language model released by Meta AI. Meta has recently released Llama 3, making it...Discuss·189 readsHow-toLlama3
Dave Gaunkysaltyoldgeek.hashnode.dev·Apr 29, 2024Setup Llama 3 using Ollama and Open-WebUITested Hardware Below is a list of hardware I've tested this setup on. In all cases things went reasonably well, the Lenovo is a little despite the RAM and I'm looking at possibly adding an eGPU in the future. Both Macs with the M1 processors run gre...Discussopen-webui