Directional Ablation Can't see 24° Rotation of the Refusal Direction
Quick Overview
A pre-registered calibration on Qwen2.5-3B-Instruct. After chemistry fine-tuning, the base-model's refusal direction is still at least as good a handle on refusal as the fine-tuned mode
mechanistic-artifacts.hashnode.dev23 min read