If RLHF trains a model to prefer answers humans like, how does it still say something completely false — and say it with total confidence? RLHF never trained the model to be right. It trained the mode
Markdown supported · ⌘↵ to post
No responses yet.