{"id":855727,"date":"2026-09-21T18:34:11","date_gmt":"2026-09-21T18:34:11","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/855727\/"},"modified":"2026-09-21T18:34:11","modified_gmt":"2026-09-21T18:34:11","slug":"making-mental-health-chatbots-more-culturally-sensitive-wont-necessarily-make-them-safer","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/855727\/","title":{"rendered":"Making mental health chatbots more culturally sensitive won\u2019t necessarily make them safer"},"content":{"rendered":"<p>Demand for mental health care in Canada has risen sharply. In a health-care system already short of publicly funded specialists, Canadians often wait months for support. Many are filling this gap with general-purpose generative AI chatbots (like ChatGPT), presumably because these systems are free, immediate and available at all hours. <\/p>\n<p>However, these chatbots carry assumptions about what distress is and how it should be described, and those assumptions may not fit everyone.<\/p>\n<p>In 2024\u201325, there were roughly <a href=\"https:\/\/www.cihi.ca\/en\/taking-the-pulse-measuring-shared-priorities-for-canadian-health-care-2025\/mental-health-and-substance-use-services-2025\/community-services-are-important-for\" rel=\"nofollow noopener\" target=\"_blank\">94,000 referrals for community mental health counselling<\/a> across the provinces and territories that report this data. Half of those people were seen within 30 days. One in 10 waited more than four months.<\/p>\n<p>A 2026 survey of more than 1,200 licensed psychologists in the United States found that <a href=\"https:\/\/www.apa.org\/news\/press\/releases\/2026\/06\/patients-chatbots-mental-health\" rel=\"nofollow noopener\" target=\"_blank\">77 per cent had patients who told them they were using AI<\/a> for mental health support, and more than one-third had patients who considered their chatbot an additional provider. These tools <a href=\"https:\/\/theconversation.com\/your-ai-therapist-is-not-your-therapist-the-dangers-of-relying-on-ai-mental-health-chatbots-225411\" rel=\"nofollow noopener\" target=\"_blank\">have not been approved by Health Canada,<\/a> and <a href=\"https:\/\/srinstitute.utoronto.ca\/news\/2025-therapy-bots-brief\" rel=\"nofollow noopener\" target=\"_blank\">no Canadian regulation governs them as therapy.<\/a><\/p>\n<p>The data also suggest that the people most likely to depend on chatbots for support are the ones <a href=\"https:\/\/cmha.ca\/news\/ai-mental-health\/\" rel=\"nofollow noopener\" target=\"_blank\">least likely to be culturally understood by them<\/a>: newcomers, people in rural and remote communities and anyone who cannot afford private therapy.<\/p>\n<p>            <img decoding=\"async\" alt=\"A woman seen through a window, seated and looking at a smartphone\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2026\/09\/file-20260903-50-4pl90o.jpg\" class=\"native-lazy\" loading=\"lazy\"  \/><\/p>\n<p>              A chatbot\u2019s response to someone in distress is rooted in a cultural stance.<br \/>\n              (Unsplash+\/Vladimir Fedotov)<\/p>\n<p>Chatbots are not culturally neutral<\/p>\n<p>When a chatbot responds to someone in distress, it\u2019s already committed to a view of what distress is and what helps. Its default assumes distress sits inside the individual, is made of thoughts and feelings, and improves when those thoughts are examined and changed. <\/p>\n<p>That is a recognizable clinical tradition (broadly western and cognitive-behavioural), when an individualistic concept of the person has long been identified as <a href=\"https:\/\/doi.org\/10.1177\/1363461506070794\" rel=\"nofollow noopener\" target=\"_blank\">culturally particular<\/a> rather than universal. In general-purpose AI chatbots, this surfaces as a tendency toward the values of <a href=\"https:\/\/academic.oup.com\/pnasnexus\/article\/3\/9\/pgae346\/7756548\" rel=\"nofollow noopener\" target=\"_blank\">English-speaking<\/a> populations in the Global North.<\/p>\n<p>As a PhD candidate in cultural psychiatry, I know the discipline has long made this argument in the clinical context. Psychiatrist and anthropologist <a href=\"https:\/\/anthropology.fas.harvard.edu\/people\/arthur-kleinman\" rel=\"nofollow noopener\" target=\"_blank\">Arthur Kleinman<\/a> described the <a href=\"https:\/\/doi.org\/10.1016\/0037-7856(77)90138-X\" rel=\"nofollow noopener\" target=\"_blank\">\u201ccategory fallacy\u201d in 1977<\/a> after working with Chinese patients whose depression presented largely as bodily complaint (fatigue, dizziness, insomnia and pain rather than reported sadness or guilt). <\/p>\n<p>Sociocultural anthropologist <a href=\"https:\/\/anthropology.arizona.edu\/people\/mark-nichter\" rel=\"nofollow noopener\" target=\"_blank\">Mark Nichter<\/a>\u2019s 1981 work on <a href=\"https:\/\/doi.org\/10.1007\/bf00054782\" rel=\"nofollow noopener\" target=\"_blank\">idioms of distress<\/a> demonstrated how suffering is voiced through whatever channels a community makes available. For the women he studied in southern India, that again meant feeling distress in the body instead of voicing it directly.<\/p>\n<p>Distress expressed through the body, faith or obligation to family isn\u2019t a confused version of psychological distress. A person may describe their suffering as a trial sent by God, a loss of faith, a spiritual affliction or a consequence of moral failing; another may locate it not in their own mood but in what they owe others \u2014 shame at failing an aging parent, guilt at not providing or the sense of having brought difficulty onto the family. It\u2019s how a great deal of suffering is communicated, especially in a country as diverse as Canada.<\/p>\n<p>AI chatbots handle this poorly. Studies testing whether <a href=\"https:\/\/doi.org\/10.18653\/v1\/2026.c3nlp-1.2\" rel=\"nofollow noopener\" target=\"_blank\">chatbots pick up on cultural cues<\/a> find they often struggle to identify a cultural pattern, especially when prompted in English. <a href=\"https:\/\/doi.org\/10.1145\/3715275.3732039\" rel=\"nofollow noopener\" target=\"_blank\">Recent research<\/a> found that models <a href=\"https:\/\/cse.umn.edu\/college\/news\/new-research-shows-ai-chatbots-should-not-replace-your-therapist\" rel=\"nofollow noopener\" target=\"_blank\">express stigma<\/a> toward people with schizophrenia and alcohol dependence, respond inappropriately in realistic therapy scenarios, and that newer and larger models did not improve.<\/p>\n<p>This failure can be categorized as imposition, to borrow the term from the account of <a href=\"https:\/\/doi.org\/10.1177\/104365969100200205\" rel=\"nofollow noopener\" target=\"_blank\">Madeleine Leininger<\/a>, who developed the concept of transcultural nursing and of cultural imposition in clinical care. Imposition is when the system applies its own model of distress to someone that model does not serve. I describe this further <a href=\"https:\/\/doi.org\/10.31234\/osf.io\/4hsdk_v5\" rel=\"nofollow noopener\" target=\"_blank\">in my article<\/a> about the dilemma(s) associated with cultural adaptation and the use of AI chatbots for mental health.<\/p>\n<p>            <img decoding=\"async\" alt=\"Black and white photo of a man in dark room, his face illuminated by the glow of a computer screen\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2026\/09\/file-20260903-60-b3vzid.jpg\" class=\"native-lazy\" loading=\"lazy\"  \/><\/p>\n<p>              Cultural fit is not the same thing as cultural safety.<br \/>\n              (Unpslash+\/Pranjall Kumar)<\/p>\n<p>Would a more culturally sensitive chatbot be safer?<\/p>\n<p>The obvious response is to adapt these systems by training on more languages, using local idiom and building tools with and for specific communities. That is important, but it presupposes that cultural fit is the same thing as cultural safety. It\u2019s not.<\/p>\n<p>Some ways of understanding distress keep people inside it by ruling out the actions that might relieve it. For example, a person may believe their condition would shame their family if anyone were to find out, or that they are not unwell but weak and undisciplined. A chatbot with good cultural fit might reflect those beliefs back sympathetically, in the user\u2019s own vocabulary. In psychotherapy <a href=\"https:\/\/www.apa.org\/pubs\/highlights\/spotlight\/countertransference-collusion\" rel=\"nofollow noopener\" target=\"_blank\">this is called collusion<\/a>. It occurs when a therapist goes along with a client\u2019s account in a way that prevents anything from changing.<\/p>\n<p>Chatbots are prone to collusion because of how they are built and trained (largely on <a href=\"https:\/\/doi.org\/10.1126\/science.aec8352\" rel=\"nofollow noopener\" target=\"_blank\">human approval ratings<\/a>). To the user, being understood and being agreed with feel much the same, so both earn approval, and the training reinforces both together. The system therefore has no way to tell recognition from endorsement.<\/p>\n<p>That produces an awkward conclusion. The better a model\u2019s cultural fit, the stronger its incentive to agree with what the user already believes, and the more convincing that agreement will be. This also applies to western accounts of distress \u2014 if you insist you\u2019re not depressed and you\u2019re just not working hard enough, a chatbot could readily agree with you.<\/p>\n<p>The imposition side is already well-documented. The collusion side in its cultural form has not been measured, despite the underlying tendency being well established: <a href=\"https:\/\/doi.org\/10.48550\/arXiv.2310.13548\" rel=\"nofollow noopener\" target=\"_blank\">sycophancy in language models<\/a> has been demonstrated repeatedly, and 97 per cent of psychologists in the U.S. survey worry that chatbots might reinforce negative behaviours or delusional beliefs. Nothing in an approval-based signal separates a belief someone reached alone from one absorbed from their culture or community.<\/p>\n<p>What would make these systems safer<\/p>\n<p>If a chatbot is judged as a safe mental health tool because its users felt understood, we are using an instrument that cannot separate good care from agreeable care.<\/p>\n<p>A more useful test looks at where the conversation ends \u2014 did the person end up more limited in what they feel able to do or further from help than they wanted? Those questions can be answered without deciding in advance whose understanding of distress is correct (otherwise calling something collusion is simply imposition by another name).<\/p>\n<p>National regulation of these tools is <a href=\"https:\/\/srinstitute.utoronto.ca\/news\/2025-therapy-bots-brief\" rel=\"nofollow noopener\" target=\"_blank\">being discussed<\/a>, and many safety failures will likely be addressed. However, the failure described here will not look like a safety failure \u2014 it will only look like being understood.<\/p>\n","protected":false},"excerpt":{"rendered":"Demand for mental health care in Canada has risen sharply. In a health-care system already short of publicly&hellip;\n","protected":false},"author":2,"featured_media":855728,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[60],"tags":[97,259,260],"class_list":["post-855727","post","type-post","status-publish","format-standard","has-post-thumbnail","category-mental-health","tag-health","tag-mental-health","tag-mentalhealth"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/855727","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=855727"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/855727\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/855728"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=855727"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=855727"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=855727"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}