---
title: "Discussion on \"Run GPT4ALL Locally and Build a Simple QnA Program\" | Hashnode"
description: "Discussion on \"Run GPT4ALL Locally and Build a Simple QnA Program\". Introduction 🙋🏻‍♂️\nHey Guys, It's Tanmay here, and today I'll be talking about How you can run a smaller version of LLM on your machine directly, totally free of cost.\nAs we all know, Using and building on top of LLMs is costlier. Some students and..."
url: "https://hashnode.com/posts/run-gpt4all-locally-and-build-a-simple-qna-program/64aec833e9b625f83ab8bd38"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Run GPT4ALL Locally and Build a Simple QnA Program](https://tanmaysarkar.hashnode.dev/run-gpt4all-locally-and-build-a-simple-qna-program?utm_source=hashnode&utm_medium=feed)

Introduction 🙋🏻‍♂️ Hey Guys, It's Tanmay here, and today I'll be talking about How you can run a smaller version of LLM on your machine directly, totally free of cost. As we all know, Using and building on top of LLMs is costlier. Some students and...

Jul 12, 2023 · 5 min read · tanmaysarkar.hashnode.dev  
Read the article

-   [#wemakedevs](https://hashnode.com/tag/wemakedevs)
-   [#gpt-4](https://hashnode.com/tag/gpt-4)
-   [#langchain](https://hashnode.com/tag/langchain)
-   [#gpt4all](https://hashnode.com/tag/gpt4all)

## Written by

[Tanmay Sarkar](https://hashnode.com/@tanmaysarkar)

@tanmaysarkar · India

  
[View profile](https://hashnode.com/@tanmaysarkar)

Career centric these days.

DevOps and Open Source Enthusiast and CSE Student

## Responses 1

Markdown supported · ⌘↵ to post

[Karan Janthe](https://hashnode.com/@KaranJanthe)

[Jul 15, 2023](https://hashnode.com/posts/run-gpt4all-locally-and-build-a-simple-qna-program/64aec833e9b625f83ab8bd38/comment/64b226d70470cd817f0dd4b3)

i was stuck,

first issue was i didn't have that much storage, so weights didn't converted,

after clearing storage it worked,

and the second issue was version of gpt4all,

which i fixed using

pip install 'pygpt4all==v1.0.1' --force-reinstall

reference: [github.com/hwchase17/langchain/issues/3839](https://github.com/hwchase17/langchain/issues/3839)

[Tanmay Sarkar](https://hashnode.com/@tanmaysarkar)

[Jul 15, 2023](https://hashnode.com/posts/run-gpt4all-locally-and-build-a-simple-qna-program/64aec833e9b625f83ab8bd38/comment/64b226d70470cd817f0dd4b3#reply-64b27cbc01a02a8720b354c3)

Ohh that's great. Can you also mention your machine specs also?
