---
title: "Discussion on \"Parameter-Efficient Fine-Tuning: From LoRA to QLoRA\" | Hashnode"
description: "Discussion on \"Parameter-Efficient Fine-Tuning: From LoRA to QLoRA\". Fine-tuning Large Language Models (LLMs) used to be an option only for organizations with massive compute budgets. Full fine-tuning requires updating and storing every parameter, gradient, and optimiz"
url: "https://hashnode.com/posts/parameter-efficient-fine-tuning-from-lora-to-qlora/6aaa2c781ddc873f8d269492"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Parameter-Efficient Fine-Tuning: From LoRA to QLoRA](https://rahul-ai.hashnode.dev/parameter-efficient-fine-tuning-from-lora-to-qlora?utm_source=hashnode&utm_medium=feed)

Fine-tuning Large Language Models (LLMs) used to be an option only for organizations with massive compute budgets. Full fine-tuning requires updating and storing every parameter, gradient, and optimiz

Sep 16 · 10 min read · rahul-ai.hashnode.dev  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#AI](https://hashnode.com/tag/AI)
-   [#peft](https://hashnode.com/tag/peft)
-   [#finetuning](https://hashnode.com/tag/finetuning)
-   [#fine-tuning](https://hashnode.com/tag/fine-tuning)
-   [#fine-tune](https://hashnode.com/tag/fine-tune)
-   [#fine-tuning-models](https://hashnode.com/tag/fine-tuning-models)
-   [#lora](https://hashnode.com/tag/lora)
-   [#qlora](https://hashnode.com/tag/qlora)
-   [#quantization](https://hashnode.com/tag/quantization)

## Written by

[Rahul Sai Indeevar V](https://hashnode.com/@rahul-ai)

@rahul-ai · India

  
[View profile](https://hashnode.com/@rahul-ai)

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
