In brief
\nA new study shows LLMs can mimic human purchase intent by mapping free-text answers to Likert ratings through semantic similarity.
\nMethod achieved 90% of human test\u2013retest reliability on 9,300 real survey responses.
\nThe study raises questions about bias, generalization, and how far \u201csynthetic consumers\u201d can stand in for real people.<\/p>\n
Forget focus groups: A new study found that large language models can forecast whether you want to buy something with striking accuracy, dramatically outperforming traditional marketing tools.<\/p>\n
Researchers at the University of Mannheim and ETH Z\u00fcrich have found that large language models can replicate human purchase intent\u2014the \u201cHow likely are you to buy this?\u201d metric beloved by marketers\u2014by transforming free-form text into structured survey data.<\/p>\n
In a paper<\/a> published last week, the team introduced a method called “Semantic Similarity Rating,” which\u00a0converts the model\u2019s open-ended responses into numerical \u201cLikert<\/a>\u201d ratings, a five-point scale used in traditional consumer research.<\/p>\n Rather than asking a model to pick a number between one and five, the researchers had it respond naturally\u2014\u201cI\u2019d definitely buy this,\u201d or \u201cMaybe if it were on sale\u201d\u2014and then measured how semantically close those statements were to canonical answers like \u201cI would definitely buy this\u201d or \u201cI would not buy this.\u201d<\/p>\n \ufeff<\/p>\n Each answer was mapped in embedding space to the nearest reference statement, effectively turning LLM text into statistical ratings. \u201cWe show that optimizing for semantic similarity rather than numeric labels yields purchase-intent distributions that closely match human survey data,\u201d the authors wrote. \u201cLLM-generated responses achieved 90% of the reliability of repeated human surveys while preserving natural variation in attitudes.\u201d<\/p>\n In tests across 9,300 real human survey responses about personal-care products, the SSR method produced synthetic respondents whose Likert distributions nearly mirrored the originals. In other words: when asked to \u201cthink like consumers,\u201d the models did.<\/p>\n Why it matters<\/p>\n The finding could reshape how companies conduct product testing and market research. Consumer surveys are notoriously expensive, slow, and vulnerable to bias. Synthetic respondents\u2014if they behave like real ones\u2014could let companies screen thousands of products or messages for a fraction of the cost.<\/p>\n It also validates a deeper claim: that the geometry of an LLM\u2019s semantic space encodes not just language understanding but attitudinal reasoning. By comparing answers in embedding space rather than treating them as literal text, the study demonstrates that model semantics can stand in for human judgment with surprising fidelity.<\/p>\n At the same time, it raises familiar ethical and methodological risks. The researchers tested only one product category, leaving open whether the same approach would hold for financial decisions or politically charged topics. And synthetic \u201cconsumers\u201d could easily become synthetic targets: the same modeling techniques could help optimize political persuasion, advertising, or behavioral nudges.<\/p>\n As the authors put it, \u201cmarket-driven optimization pressures can systematically erode alignment\u201d\u2014a phrase that resonates far beyond marketing.<\/p>\n A note of skepticism<\/p>\n The authors acknowledge that their test domain\u2014personal-care products\u2014is narrow and may not generalize to high-stakes or emotionally charged purchases. The SSR mapping also depends on carefully chosen reference statements: small wording changes can skew results. Moreover, the study relies on human survey data as \u201cground truth,\u201d even though such data is notoriously noisy and culturally biased.<\/p>\n Critics point out that embedding-based similarity assumes that language vectors map neatly onto human attitudes, an assumption that may fail when context or irony enters the mix. The paper\u2019s own reliability numbers\u201490% of human test-retest consistency\u2014sound impressive but still leave room for significant drift. In short, the method works on average, but it\u2019s not yet clear whether those averages capture real human diversity or simply reflect the model\u2019s training priors.<\/p>\n The bigger picture<\/p>\n Academic interest in \u201csynthetic consumer modeling\u201d has surged in 2025 as companies experiment with AI-based focus groups and predictive polling. Similar work by MIT and the University of Cambridge has shown that LLMs can mimic demographic and psychometric segments with moderate reliability, but none have previously demonstrated a close statistical match to real purchase-intent data.<\/p>\n For now, the SSR method remains a research prototype, but it hints at a future where LLMs might not just answer questions\u2014but represent the public itself.<\/p>\n Whether that\u2019s an advance or a hallucination in the making is still up for debate.<\/p>\n Generally Intelligent Newsletter<\/p>\n A weekly AI journey narrated by Gen, a generative AI model.<\/p>\n","protected":false},"excerpt":{"rendered":"In brief A new study shows LLMs can mimic human purchase intent by mapping free-text answers to Likert…\n","protected":false},"author":2,"featured_media":70346,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,85,46,125],"class_list":["post-70345","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-il","tag-israel","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/70345","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=70345"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/70345\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/70346"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=70345"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=70345"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=70345"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}