---
title: "Discussion on \"Mode collapse is a default, not a law: what preference tuning does to variety\" | Hashnode"
description: "Discussion on \"Mode collapse is a default, not a law: what preference tuning does to variety\". Why 25 models give you two metaphors, and why temperature doesn't fix it"
url: "https://hashnode.com/posts/mode-collapse-is-a-default-not-a-law-what-preference-tuning-does-to-variety/6af2507576ce69d8c82799e1"
---

[Feed](https://hashnode.com/feed) /

Discussion

# [Mode collapse is a default, not a law: what preference tuning does to variety](https://piszczek.hashnode.dev/mode-collapse-is-a-default-not-a-law-what-preference-tuning-does-to-variety?utm_source=hashnode&utm_medium=feed)

Why 25 models give you two metaphors, and why temperature doesn't fix it

Nov 9 · 11 min read · piszczek.hashnode.dev  
Read the article

-   [#ai](https://hashnode.com/tag/ai)
-   [#llm](https://hashnode.com/tag/llm)
-   [#machine-learning](https://hashnode.com/tag/machine-learning)
-   [#fine-tuning](https://hashnode.com/tag/fine-tuning)

## Written by

[Michał Piszczek](https://hashnode.com/@michalpiszczek)

@michalpiszczek · Kraków, Poland

  
[View profile](https://hashnode.com/@michalpiszczek)

CEO / CTO / Founder. AI infrastructure & economics. Author of the Joule Wars concept — piszczek.pl

CTO of Archdesk; founder and former CEO of Robotero (acquired), Rejsomat.pl, Inclify and Lextron.ai. Ex white-hat hacker. I write about AI infrastructure &amp; economics — author of the Joule Wars concept. Home: https://piszczek.pl

## Responses

Markdown supported · ⌘↵ to post

No responses yet.
