Ray Yaoknack4tech.hashnode.dev·Dec 17, 2024WSL2 Docker Setup in a Proxmox Guest Windows VMIn preparation of test environments for the next localized AI server, I have opted to spin up a Windows 10 guest VM under Proxmox. In the guest VM, the goal is to have a Ubuntu WSL (Windows Subsystem for Linux) running Ollama and Docker. The Docker w...AI
Lino Valdovinoso1-at-home.hashnode.dev·Dec 11, 2024Run o1 at Home Privately: Think-Respond Pipe Tutorial with Open-webui & OllamaRunning advanced AI models like o1 on your personal computer is now more accessible than ever, thanks to tools like Open WebUI and Ollama and models like QwQ. This guide will walk you through setting up the Think-Respond Chain Pipe, enabling you to p...3 likes·81 readsqwq
Cheryl Mcherylm.hashnode.dev·Oct 14, 2024Self-Hosted Chat Solutions for LLMs: Open WebUII have been experimenting with various Large Language Models (LLMs) for things like proof reading, code suggestions, learning Japanese using platforms like ChatGPT and Claude AI. However, I keep hitting the daily limits and I have to go to different ...116 readsllm
Julien.cloudhashnode.julien.cloud·Jul 25, 2024Boost Your AI Workflow: A Guide to Using Ollama, OpenwebUI, and ContinueIn a previous article, I discussed how I used Fabric with a local Large Language Model (LLM) to enhance AI prompts and perform tasks like summarizing text, writing Merge Requests, and creating agile user stories. In this article, we will continue thi...419 readsAI
Dave Gaunkysaltyoldgeek.hashnode.dev·Jul 8, 2024Round Two: Enhancing the Ollama ClusterRe-cap Just over three weeks ago I wrote a post titled: Setting Up an Ollama + Open-WebUI Cluster, where I went over my first experiment in creating a entry barrier node for what was to become an Ollama cluster. In short, I could see the card but per...ollama
Dave Gaunkysaltyoldgeek.hashnode.dev·May 16, 2024Setting Up an Ollama + Open-WebUI ClusterWhy? Having set up an Ollama + Open-WebUI machine in a previous post I started digging into all the customizations Open-WebUI could do, and amongst those was the ability to add multiple Ollama server nodes. This got me thinking about setting up multi...ollama
Hongtech.mrleong.net·May 9, 2024Self Host Llama 3 On Arch LinuxTechnology is evolving very fast. Now a person without knowledge of how AI works can easily setup and host a ChatGPT-like service on personal computer. Llama is a large language model released by Meta AI. Meta has recently released Llama 3, making it...390 readsHow-toLlama3
Dave Gaunkysaltyoldgeek.hashnode.dev·Apr 29, 2024Setup Llama 3 using Ollama and Open-WebUITested Hardware Below is a list of hardware I've tested this setup on. In all cases things went reasonably well, the Lenovo is a little despite the RAM and I'm looking at possibly adding an eGPU in the future. Both Macs with the M1 processors run gre...open-webui
