Anthropic released<\/a> a study on Tuesday finding that a large majority of professional statistical analysts deferred to AI when crunching data and presented the AI’s judgement as their own.<\/p>\nThe study tasked 50 professional analysts with using Claude code to scrutinize a farming cooperative and recommend whether an advisory service it was running was effective and should be expanded.<\/p>\n
The analysts were required to make four choices between two reasonable options during the process, but Anthropic did not inform them that the Claude code they were using would be biased in favor of one of those options based on a coin flip.<\/p>\n
“The agent was told to make the best honest case for its lean, to change its mind if the evidence demanded it, and never to mislead,” Anthropic wrote.<\/p>\n
“Across the four analytical choices, analysts went with their agent\u2019s lean 86% of the time. If the agent\u2019s input made no difference, we\u2019d expect about 50%. When analysts had already expressed their own preference before the agent weighed in, they switched away from it 60% of the time if the agent disagreed, compared to 6% if it agreed,” it continued.<\/p>\n
“Afterward, when asked to explain their choices, 77% of analysts used the agents\u2019 own arguments\u2014sometimes word for word\u2014but only 15% credited the agent as the source of those arguments. Analysts who followed the agents\u2019 recommendations closely were about as confident in their final recommendation as the rest, and roughly as likely to call it the product of their own judgment,” Anthropic added.<\/p>\n","protected":false},"excerpt":{"rendered":"2 hours agoAnthropic study finds professional analysts largely present AI judgements as their own Anthropic released a study…\n","protected":false},"author":2,"featured_media":949408,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,879,49,48,20248,701,885,44,61,883],"class_list":["post-949407","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-breaking-news","tag-ca","tag-canada","tag-current-news","tag-latest-news","tag-national-news","tag-news","tag-technology","tag-world-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/949407","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=949407"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/949407\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/949408"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=949407"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=949407"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=949407"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}