© 2026 Hashnode
Key Highlights Fine-tuning the LLaMA 3.2 90B model requires at least 180 GB of VRAM, making it challenging for local setups. Memory limitations can make fine-tuning LLaMA 3.2 90B challenging. Parameter-efficient fine-tuning (PEFT) methods like LoRA a...

This is just a small blog post on some things I've noticed with my new WIP Chatbot, nanoChatGPT. Ever since I completed the personaChat dataset and upgraded from gpt2 to gpt2-medium, I've noticed a big boost in its ability to sound more human. for a ...
