---
title: "Discussion on \"Step-by-Step Guide to Local RAG with Ollama's Gemma 2, and LangChain.dart\" | Hashnode"
description: "Discussion on \"Step-by-Step Guide to Local RAG with Ollama's Gemma 2, and LangChain.dart\". Learn how to build a fully local RAG (Retrieval-Augmented Generation) system using LangChain.dart, Ollama and local embedding databases with Chroma"
url: "https://hashnode.com/posts/step-by-step-guide-to-local-rag-with-ollamas-gemma-2-and-langchaindart/676055a4fc202f8b725deb9e"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Step-by-Step Guide to Local RAG with Ollama's Gemma 2, and LangChain.dart](https://sibylsystems.com/step-by-step-guide-to-local-rag-with-ollamas-gemma-2-and-langchaindart?utm_source=hashnode&utm_medium=feed)

Learn how to build a fully local RAG (Retrieval-Augmented Generation) system using LangChain.dart, Ollama and local embedding databases with Chroma

Dec 16, 2024 · 23 min read · sibylsystems.com  
Updated Dec 26, 2024  
Read the article

-   [#rag](https://hashnode.com/tag/rag)
-   [#retrieval-augmented-generation](https://hashnode.com/tag/retrieval-augmented-generation)
-   [#language-models](https://hashnode.com/tag/language-models)
-   [#ollama](https://hashnode.com/tag/ollama)
-   [#gemma2](https://hashnode.com/tag/gemma2)
-   [#langchaindart](https://hashnode.com/tag/langchaindart)
-   [#langchain](https://hashnode.com/tag/langchain)
-   [#chromadb](https://hashnode.com/tag/chromadb)
-   [#vector-embeddings](https://hashnode.com/tag/vector-embeddings)
-   [#text-embeddings](https://hashnode.com/tag/text-embeddings)
-   [#promptengineering](https://hashnode.com/tag/promptengineering)
-   [#prompt-template](https://hashnode.com/tag/prompt-template)
-   [#agents](https://hashnode.com/tag/agents)
-   [#embeddings](https://hashnode.com/tag/embeddings)

## Written by

[Henry Adu](https://hashnode.com/@HenryAdu)

@HenryAdu · Ghana

  
[View profile](https://hashnode.com/@HenryAdu)

Software Engineer @ Phundit

I am a developer from Ghana with a Computer Science background and a passion for developing software. I've designed, developed and published multiple apps on the play store like Sports Scoreboard and Learn Akan. Always eager to learn about new technologies and collaborate on Flutter projects.

## Responses

Markdown supported · ⌘↵ to post

[Phil Milner](https://hashnode.com/@milnerphil)

[Jan 9, 2025](https://hashnode.com/posts/step-by-step-guide-to-local-rag-with-ollamas-gemma-2-and-langchaindart/676055a4fc202f8b725deb9e/comment/677fe4b1560e7ebfb85e3071)

Your code works but I'm getting the error: localhost:11434/api/embeddings file not found, any insight on that? milnerphil@gmail.com