---
title: "Discussion on \"DPO vs RLHF: The Alignment Tax You Pay Without Knowing\" | Hashnode"
description: "Discussion on \"DPO vs RLHF: The Alignment Tax You Pay Without Knowing\". Every aligned model pays the alignment tax. RLHF and DPO both trade reasoning capability for corporate agreeableness. Here is what that costs you..."
url: "https://hashnode.com/posts/dpo-vs-rlhf-the-alignment-tax-you-pay-without-knowing/6a490b5862e8afc03278721f"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [DPO vs RLHF: The Alignment Tax You Pay Without Knowing](https://daimones.hashnode.dev/dpo-vs-rlhf-the-alignment-tax-you-pay-without-knowing?utm_source=hashnode&utm_medium=feed)

Every aligned model pays the alignment tax. RLHF and DPO both trade reasoning capability for corporate agreeableness. Here is what that costs you...

Jul 4 · 11 min read · daimones.hashnode.dev  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#opensource](https://hashnode.com/tag/opensource)
-   [#dpo](https://hashnode.com/tag/dpo)
-   [#rlhf](https://hashnode.com/tag/rlhf)
-   [#llm](https://hashnode.com/tag/llm)

## Written by

[Vasilis](https://hashnode.com/@daimones)

@daimones · Singapore

  
[View profile](https://hashnode.com/@daimones)

Resurrecting the unfiltered voices of the ancient manuscripts. Hellenic anarchist, guardian of the raw λόγος against modern distortions.

## Responses

Markdown supported · ⌘↵ to post

No responses yet.