4-bit NF4 quantization for llama guard 3

this quantization will help for users with low vram and get desired result but note using 4 bit quantization has its drawback. import torch from transformers import AutoTokenizer, AutoModelForCausalLM