--- title: "Discussion on \"Individual Scores in Choice Models, Part 1: Data & Averages\" | Hashnode" description: "Discussion on \"Individual Scores in Choice Models, Part 1: Data & Averages\". Before jumping into today’s topic, I will highlight the previous post in case you missed it: guest author — and coauthor of the Quant UX book — Kerry Rodden discusses HEART metrics. It updates Kerry’s classic description of HEART with new reflections..." url: "https://hashnode.com/posts/individual-scores-in-choice-models-part-1-data-averages/6719093f02fce2fb3a4ce556" --- [Feed](https://hashnode.com/feed) / Discussion # [Individual Scores in Choice Models, Part 1: Data & Averages](https://quantuxblog.com/individual-scores-in-choice-models-part-1-data-averages?utm_source=hashnode&utm_medium=feed) Before jumping into today’s topic, I will highlight the previous post in case you missed it: guest author — and coauthor of the Quant UX book — Kerry Rodden discusses HEART metrics. It updates Kerry’s classic description of HEART with new reflections... Oct 23, 2024 · 16 min read · quantuxblog.com Updated May 11, 2025 Read the article - [#r](https://hashnode.com/tag/r) - [#quantux](https://hashnode.com/tag/quantux) - [#uxresearch](https://hashnode.com/tag/uxresearch) - [#marketing-research](https://hashnode.com/tag/marketing-research) - [#conjoint](https://hashnode.com/tag/conjoint) ## Written by [Chris Chapman](https://hashnode.com/@chrischapman) @chrischapman · Seattle [View profile](https://hashnode.com/@chrischapman) R, Quant UX, and Marketing Research author. Executive Director, Quant UX Association. President, Quant UX Association. Previously: Principal UX Researcher @ Google; Amazon Lab 126; Microsoft. Author of "Quantitative User Experience Research" and "\[R | Python\] for Marketing Research and Analytics". ## Responses 2 Markdown supported · ⌘↵ to post [Thomas Hettig](https://hashnode.com/@thettig) [Jan 24, 2025](https://hashnode.com/posts/individual-scores-in-choice-models-part-1-data-averages/6719093f02fce2fb3a4ce556/comment/6793bf8010819aaa5413552e) Thanks [Chris Chapman](https://hashnode.com/@chrischapman) for this great blog article! In your Quant UX book, you recommend using a higher number of tasks per participant to achieve precise individual-level estimates. However, in this blog, you used only 6 tasks for the MaxDiff analysis, which, according to your book, would primarily yield precise sample-level estimates. I’m curious: How much of an impact does a relatively low number of tasks have on the precision of individual-level estimates? Can you elaborate when I should definitely follow the textbook recommendation of 12-15 tasks (depending on the specific MaxDiff)? I would think that a segmentation study needs more accuracy then a simple analysis if there is an item that is highly important to some survey participants?! [Thomas Hettig](https://hashnode.com/@thettig) [Jan 24, 2025](https://hashnode.com/posts/individual-scores-in-choice-models-part-1-data-averages/6719093f02fce2fb3a4ce556/comment/6793bf8010819aaa5413552e#reply-6793e2aa6ff97aedcc776eb5) Thanks for your reply [Chris Chapman](https://hashnode.com/@chrischapman)! I didn’t know that LCA could estimate segments alongside utilities. I’d like to apply the methods you described in this blog to a current project. My survey includes some additional questions besides the MaxDiff tasks, and I don’t want to stretch participants’ patience too much. I’m wondering if it’s feasible to show each item an average of only two times per respondent and still obtain informative individual-level results. Or do you think this would be a “bad” idea and that it’s better to avoid analyzing individual scores in this case? The answer is probably, “It depends,” but if I’m not conducting a segmentation study and just want to identify whether some items seem particularly important to certain respondents, could the following principle apply? “Our job is to help make decisions under uncertainty. We aim to take better bets. Sometimes it’s acceptable to show items only twice on average, if that’s the best we can reasonably do.” [Chris Chapman](https://hashnode.com/@chrischapman) [Jan 24, 2025](https://hashnode.com/posts/individual-scores-in-choice-models-part-1-data-averages/6719093f02fce2fb3a4ce556/comment/6793bf8010819aaa5413552e#reply-6793e3b0b20ef161a91b441a) [Thomas Hettig](https://hashnode.com/@thettig) That is exactly what I would do — run the survey with the best experience I can to get good data from a good respondent experience, and not worry about whether I have some "right" number of observations. The other thing I would say is this: for any single individual, the specific estimates in that case are imprecise, but the overall averages & estimated numbers of individuals preferring one thing or another will be precise. Unless you are specifically targeting individuals, that is good enough for almost everything (some forms of segmentation being the exception). [Thomas Hettig](https://hashnode.com/@thettig) [Jan 24, 2025](https://hashnode.com/posts/individual-scores-in-choice-models-part-1-data-averages/6719093f02fce2fb3a4ce556/comment/6793bf8010819aaa5413552e#reply-6793e961115559a919e1ec01) Cool! Thank you so much Chris!