Feb 2 · 9 min read · A journey through self-hosted LLMs, MCP integration challenges, and cost-effective observability The promise is compelling: connect your personal knowledge base to AI assistants while keeping everything within EU borders. No data leaving the contine...
Join discussion
Nov 5, 2025 · 2 min read · Let’s say you want a ChatGPT-like interface to access the models you’ve set up in LiteLLM. Let’s add that to the docker_compose.yaml that we’ve been building up. The first thing you’ll need is an API key access your LiteLLM server. To create one, go ...
Join discussion
Sep 30, 2025 · 5 min read · Let's face it: getting started with large language models (LLMs) often comes with a hefty price tag or a headache-inducing setup. You either shell out big bucks for a powerful GPU or wrestle with complicated environment configurations just to experim...
Join discussionDec 11, 2024 · 3 min read · Running advanced AI models like o1 on your personal computer is now more accessible than ever, thanks to tools like Open WebUI and Ollama and models like QwQ. This guide will walk you through setting up the Think-Respond Chain Pipe, enabling you to p...
Join discussion
Oct 1, 2024 · 4 min read · Did you know you can run powerful AI models right on your computer? It’s true! Today, I will show you how easy it is to get started with Llama 3.2 and OpenWebUI. https://youtu.be/woUB_vhoML0?si=woNYpjwHLV3zUj51 Watch on YouTube: Run AI On YOUR Comp...
Join discussion