---
title: "Discussion on \"Deploying Gemma 1B GGUF model with llama.cpp on Ubuntu\" | Hashnode"
description: "Discussion on \"Deploying Gemma 1B GGUF model with llama.cpp on Ubuntu\". This is a step-by-step guide on deploying and interacting with quantized gemma 1b from Google using llama-server"
url: "https://hashnode.com/posts/deploying-gemma-1b-gguf-model-with-llamacpp-on-ubuntu/67e06978212b1ce2f5b7723e"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Deploying Gemma 1B GGUF model with llama.cpp on Ubuntu](https://pranjalisachan.hashnode.dev/deploying-gemma-1b-gguf-model-with-llamacpp-on-ubuntu?utm_source=hashnode&utm_medium=feed)

This is a step-by-step guide on deploying and interacting with quantized gemma 1b from Google using llama-server

Mar 23, 2025 · 5 min read · pranjalisachan.hashnode.dev  
Read the article

-   [#llama-server](https://hashnode.com/tag/llama-server)
-   [#gemma-1b-it](https://hashnode.com/tag/gemma-1b-it)
-   [#llamacpp](https://hashnode.com/tag/llamacpp)
-   [#gemma](https://hashnode.com/tag/gemma)
-   [#google](https://hashnode.com/tag/google)
-   [#tmux](https://hashnode.com/tag/tmux)
-   [#ubuntu](https://hashnode.com/tag/ubuntu)
-   [#nvidia](https://hashnode.com/tag/nvidia)
-   [#unsloth](https://hashnode.com/tag/unsloth)
-   [#cuda](https://hashnode.com/tag/cuda)
-   [#cmake](https://hashnode.com/tag/cmake)
-   [#github](https://hashnode.com/tag/github)
-   [#python](https://hashnode.com/tag/python)
-   [#huggingface](https://hashnode.com/tag/huggingface)
-   [#nginx](https://hashnode.com/tag/nginx)

## Written by

[Pranjali Sachan](https://hashnode.com/@pranjalisachan)

@pranjalisachan · Pittsburgh

  
[View profile](https://hashnode.com/@pranjalisachan)

Developer

## Responses

Markdown supported · ⌘↵ to post

No responses yet.