MAMuhammad Ariel Shakaramiroinshaka-ai.hashnode.dev·6d ago · 7 min readWhat Does Fine-Tuning Actually Learn? Testing QLoRA with Deliberately Controlled DataFine-tuning is often treated as a way to "embed knowledge" into a model — but what actually happens under the hood can be far more layered than that. This post builds a small, controlled experiment — 00
MAMuhammad Ariel Shakaramiroinshaka-ai.hashnode.dev·6d ago · 7 min readFine-Tuning Llama 3.1 8B for Free on Colab: QLoRA, Unsloth, and a Compression Claim That Doesn't Hold UpAn 8-billion-parameter model usually needs tens of gigabytes of VRAM just to load, let alone retrain. But with 4-bit quantization and LoRA combined, fine-tuning a model that size can run on Colab's fr00
NSNagappan Sinnagspidey.hashnode.dev·Sep 22 · 8 min readFine-Tuning vs. Prompting: When Do You Actually Need to Fine-Tune?A team I know spent two weeks and a few hundred dollars fine-tuning a model to get their internal support bot to answer in a consistent, on-brand tone. They collected examples, cleaned them up, ran th12M
FMFeroan Mothyinferoan.hashnode.dev·Sep 17 · 6 min readI Keep Trying to Find an Excuse to Train a ModelI keep wanting to train a model. Then I start looking for a reason to train one. And that's where I get stuck. I can think of plenty of things I could build with an existing model. An API, a RAG syste00
RSRahul Sai Indeevar Vinrahul-ai.hashnode.dev·Sep 16 · 10 min readParameter-Efficient Fine-Tuning: From LoRA to QLoRAFine-tuning Large Language Models (LLMs) used to be an option only for organizations with massive compute budgets. Full fine-tuning requires updating and storing every parameter, gradient, and optimiz20
PJPraise Jamesinzenrows.hashnode.dev·Sep 14 · 8 min readWeb data for LLM fine-tuning: a practical 2026 guideThis article was originally published on the Zenrows blog. Read the original here: https://www.zenrows.com/blog/web-data-llm-fine-tuning Architecture overview LLM fine-tuning pipelines that rely enti00
RSRahul Sai Indeevar Vinrahul-ai.hashnode.dev·Sep 8 · 14 min readLLM Post-Training: From Full Fine-Tuning to PEFT, Adapters, and Soft PromptsLarge Language Models (LLMs) arrive with immense foundational knowledge acquired during pre-training. However, deploying them to specialized real-world domains—such as legal document parsing, medical 10
IDInternals Decodedininternals-decoded.hashnode.dev·Sep 2 · 15 min readFine-Tuning, Explained: Teaching an Old Model New TricksFine-tuning takes a pre-trained model and subjects it to a second round of training on a small, task-specific dataset. The result is a permanent behavior change: a generic chatbot learns to write in y00
RSRahul Sai Indeevar Vinrahul-ai.hashnode.dev·Aug 28 · 9 min readUnderstanding LoRA: Parameter-Efficient Fine-Tuning for Modern LLMsLarge Language Models (LLMs) and foundation models like LLaMA, GPT, and ViTs have billions of parameters. As these models scale, traditional full fine-tuning—updating every weight in the network—becom10
VCVishal Chandakinforwardstack.hashnode.dev·Aug 22 · 17 min readFrom Massive to Miniature: How Small Language Models Are EngineeredIn Part 1, we started with a simple question: Does every AI task need the biggest model we can afford? Often, the answer is no. A model that is considerably smaller than a frontier model can be the 00