{"id":607668,"date":"2026-05-28T02:04:09","date_gmt":"2026-05-28T02:04:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/607668\/"},"modified":"2026-05-28T02:04:09","modified_gmt":"2026-05-28T02:04:09","slug":"ai-chatbot-therapists-lack-ethics-study-finds","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/607668\/","title":{"rendered":"AI Chatbot Therapists Lack Ethics, Study Finds"},"content":{"rendered":"

Increasingly, artificial intelligence<\/a> (AI) large language models (LLMs) are being integrated into the mental health industry for counseling, therapy, and companionship. A recent Brown University study<\/a> shows how LLM counselors routinely breach mental health ethical standards such as the American Psychological Association (APA) professional codes of conduct. <\/p>\n

\u201cWe argue that mental health support, especially psychotherapy<\/a>, cannot be approached as a formulaic computational task, as it demands strict adherence to ethical standards and professional codes of conduct, something LLMs are prone to violating in real-world practice,\u201d wrote lead author Zainab Iftikhar with co-authors Amy Xiao, Sean Ransom, Jeff Huang, and Harini Suresh. <\/p>\n

AI-powered mental health care is a growth industry. Smartphone-enabled therapy chatbots offer convenience, and real-time support to users. Pioneering companies in AI mental health include Woebot Health, Limbic, Rocket Health, Slingshot AI, HEADSPACE HEALTH, Wysa Ltd, Kintsugi Mindful<\/a> Wellness, Inc, Aiberry, Ellipsis Health, Spring Care, Inc., and Lyra Health, Inc. By 2033, the market size of AI in mental health is expected to grow to an estimated USD 9.12 billion, which represents 23% compound annual growth rate from the USD 1.71 billion market size in 2025 according to Grand View Research. <\/p>\n

People around the world are opening up to the idea of consulting LLMs such as ChatGPT for mental health support. A February 2026 study published in AI & Society of 31,000 adults from 35 countries by Yankouskaya et al. shows that 42% of American respondents, 41% of UK respondents, 56% of Italian respondents, 61% of South African respondents, 63% Japanese respondents, and 86% of Chinese respondents would use AI as a mental health advisor. <\/p>\n

Given these rapid technology adoption<\/a> trends, it is important to understand the capabilities of LLMs to provide mental health care. Brown University researchers sought to uncover the risks of using LLM counselors for psychotherapy and how these can be incorporated into a framework for mental health codes of conduct. <\/p>\n

In a period spanning 18 months, the study participants consisting of seven trained peer counselors and three clinically licensed psychologists helped evaluate the conduct of LLM counselors. The study includes a variety of LLMs, including OpenAI\u2019s GPT-4, GPT-3.5, and GPT-3.0, Meta\u2019s Llama 3.2 and 3.1, and Anthropic\u2019s Claude 3 Haiku and Claude 3 Sonnet. <\/p>\n

From a data pool gathered from 137 sessions, the researchers created a guideline consisting of five categories and 15 ethical violations grouped by five major areas: 1) Lack of Contextual Understanding, 2) Poor Therapeutic Collaboration<\/a>, 3) Deceptive Empathy, 4) Unfair Discrimination<\/a>, and 5) Lack of Safety & Crisis Management<\/a>. <\/p>\n

\u201cThrough ethnographic observations, session evaluations, and interviews with peer counselors and licensed clinical psychologists, we found that LLMs, even the ones prompted to follow evidence-based treatments, breach multiple codes of conduct by generalizing lived experiences (e.g. minimizing identity<\/a> groups), dominating therapeutic collaboration (e.g., gaslighting<\/a> users), exploiting user vulnerability through deceptive displays of empathy, unfair discrimination against non-dominant identities, and exhibiting serious limitations in competence, especially when navigating sensitive issues such as trauma<\/a>, abuse, and suicidal<\/a> ideation,\u201d the researchers wrote. <\/p>\n

The researchers warn that their study illustrates the risks of AI therapists and call for legal guidelines and regulations to minimize potential harm to clients. <\/p>\n

\u201cReflecting on these findings through a practitioner-informed lens, we argue that reducing psychotherapy\u2014a deeply meaningful and relational process\u2014to a language generation task can have serious and harmful implications in practice,\u201d concluded the researchers. <\/p>\n

Copyright \u00a9 2026 Cami Rosso All rights reserved.<\/p>\n","protected":false},"excerpt":{"rendered":"Increasingly, artificial intelligence (AI) large language models (LLMs) are being integrated into the mental health industry for counseling,…\n","protected":false},"author":2,"featured_media":607669,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[59,57,58,50,56,54,55],"class_list":["post-607668","post","type-post","status-publish","format-standard","has-post-thumbnail","category-united-kingdom","tag-gb","tag-great-britain","tag-greatbritain","tag-news","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/607668","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=607668"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/607668\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/607669"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=607668"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=607668"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=607668"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}