---
title: "Discussion on \"Fine-tuning Alpaca 30b 4-bit on consumer hardware - background\" | Hashnode"
description: "Discussion on \"Fine-tuning Alpaca 30b 4-bit on consumer hardware - background\". I want to write about fine-tuning Alpaca 30b 4-bit on consumer hardware, but before I can, I'll need to give a little background. My basic goal was to figure out \"what's the most powerful AI I can customize and run on my shiny new 4090.\"\nThe answer r..."
url: "https://hashnode.com/posts/fine-tuning-alpaca-30b-4-bit-on-consumer-hardware-background/6424a0316221ff338452e11b"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Fine-tuning Alpaca 30b 4-bit on consumer hardware - background](https://erichartford.com/fine-tuning-alpaca-30b-4-bit-on-consumer-hardware-background?utm_source=hashnode&utm_medium=feed)

I want to write about fine-tuning Alpaca 30b 4-bit on consumer hardware, but before I can, I'll need to give a little background. My basic goal was to figure out "what's the most powerful AI I can customize and run on my shiny new 4090." The answer r...

Mar 29, 2023 · 3 min read · erichartford.com  
Read the article

-   [#ml](https://hashnode.com/tag/ml)
-   [#mlops](https://hashnode.com/tag/mlops)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#machine-learning-models](https://hashnode.com/tag/machine-learning-models)
-   [#chatgpt](https://hashnode.com/tag/chatgpt)

## Written by

[Eric Hartford](https://hashnode.com/@quixi)

@quixi · Charlotte, North Carolina, USA

  
[View profile](https://hashnode.com/@quixi)

Founder, Quixi AI

I make AI models like Dolphin and Samantha https://ko-fi.com/erichartford BTC 3ENBV6zdwyqieAXzZP2i3EjeZtVwEmAuo4 ETH 0xcac74542A7fF51E2fb03229A5d9D0717cB6d70C9

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
