Deploying Gemma 1B GGUF model with llama.cpp on Ubuntu

Mar 23, 2025 · 5 min read · For this guide we should be using an Ubuntu server with atleast 2 GiB of GPU VRAM, 2 VCPU Cores, 8 GiB RAM, and 50 GiB of storage. Let’s start by updating and installing necessary libraries. sudo apt update && sudo apt upgrade -y sudo apt install -y ...