{"id":92360,"date":"2025-08-18T17:29:13","date_gmt":"2025-08-18T17:29:13","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/92360\/"},"modified":"2025-08-18T17:29:13","modified_gmt":"2025-08-18T17:29:13","slug":"chatbot-therapists-are-here-but-whos-keeping-them-in-line","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/92360\/","title":{"rendered":"Chatbot therapists are here. But who\u2019s keeping them in line?"},"content":{"rendered":"<p>Ross Harper lives in fear. Not for his London start-up Limbic, Britain\u2019s first \u2014 and only \u2014 clinically validated AI therapy chatbot, but for what might happen when something goes terribly wrong at another, less robust rival. <\/p>\n<p>\u201cOne of my biggest concerns is that we have a huge setback as an industry because an unvalidated solution is allowed to be used in a high-stakes setting. And it will be unavoidable, unfortunately \u2014 there will be a tragic incident,\u201d he said. \u201cAnd then as a result, everybody will be incredibly nervous.\u201d<\/p>\n<p>These are wild times in artificial intelligence (AI), with all the \u201cend of days\u201d doom-mongering, the $200 million (\u00a3150 million) pay packets for coder and the fears for every type of white-collar job. <\/p>\n<p>But few sectors meet the criteria that AI therapy does \u2014 of being both overrun with half-baked ideas while also operating in an arena with the highest of stakes.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">\u2022 <a href=\"https:\/\/www.thetimes.com\/article\/silicon-valleys-ai-fuelled-madness-has-echoes-of-the-dotcom-crash-5jfjtk5vt\" class=\"link__RespLink-sc-1ocvixa-0 csWvlP\" rel=\"nofollow noopener\" target=\"_blank\">Silicon Valley\u2019s AI-fuelled madness has echoes of the dotcom crash<\/a><\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">Limbic has developed a bot trained in cognitive behavioral therapy (CBT) techniques, the most common form of talk therapy, <a href=\"https:\/\/www.thetimes.com\/article\/ebb-headspace-app-ai-therapy-meditation-ngmvwhm82\" class=\"link__RespLink-sc-1ocvixa-0 csWvlP\" rel=\"nofollow noopener\" target=\"_blank\">to help people dealing with mental health struggles<\/a>. It has already been integrated into nearly half of NHS Talking Therapies services after gaining regulatory approval in 2023 as a certified medical device. As a digital \u201cfront door\u201d, it handles intake, assesses patient needs, gets them booked into care and offers CBT therapy based on clinical care guidelines.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">For a health service riven by long waiting times and striking doctors, Limbic\u2019s bot provides a rare bright spot. It has already guided more than 500,000 people into care and saved tens of thousands of hours of precious human labour.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">And yet, it is operating in a Wild West. Type \u201cAI Therapy\u201d into Apple\u2019s App Store and a stream of options appear, from ChatGPT to Replika, maker of racy AI \u201cfriends\u201d; from Elon Musk\u2019s Grok, the bot that <a href=\"https:\/\/www.thetimes.com\/article\/musk-will-need-a-charmer-to-keep-winning-back-advertisers-at-x-kd0685rh9\" class=\"link__RespLink-sc-1ocvixa-0 csWvlP\" rel=\"nofollow noopener\" target=\"_blank\">only last month referred to itself as \u201cMechaHitler\u201d<\/a>, to a menagerie of \u201cwellness\u201d apps that sell themselves as therapists but, critically, lack the clinical underpinnings that any human would need to assign this label. <\/p>\n<p><img decoding=\"async\" alt=\"Photo illustration of a smartphone displaying the Grok AI app page on the App Store.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/08\/\/d9a72b39-6cac-42ae-b5eb-e03e7db73f1f.jpg\" class=\"responsive-sc-1nnon4d-0 bAbKns\"\/><\/p>\n<p>Some of Grok\u2019s responses have raised concerns<\/p>\n<p>CHENG XIN\/GETTY IMAGES<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">\u201cCompanies are playing fast and loose with what is a protected term,\u201d Harper said. \u201cIf you\u2019re a human, you can\u2019t call yourself a therapist if you don\u2019t have a licence to do so.\u201d<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">Indeed, a surfeit of stories have surfaced in recent months of people turning to ChatGPT for a sympathetic ear. Some strike up deep relationships, others have been guided deeper into their own delusions.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">The profusion of AI therapy bots speaks not only to the peril but also the need. \u201cThe problem that we\u2019re really targeting is one of supply and demand,\u201d Harper said. \u201cThere are just not enough trained mental health professionals alive on the planet to serve the astronomical number of individuals struggling with a mental health issue.\u201d <\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">A 2023 report by the Virginia-based National Alliance on Mental Illness found that nearly half of the 60 million Americans with mental health issues go untreated. The gap is even worse in Britain, where the charity Mind estimates that only a third of people suffering from mental illness receive care.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">The arrival of large language models (LLMs), capable of understanding complex ideas and responding to queries in natural language, presented an opportunity that dozens of companies have seized upon. Most take the form of direct-to-consumer apps that are free to download and charge a flat monthly fee for access.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">\u2022 <a href=\"https:\/\/www.thetimes.com\/article\/young-people-using-chatgpt-therapy-nhs-waiting-lists-sxjp9b6hj\" class=\"link__RespLink-sc-1ocvixa-0 csWvlP\" rel=\"nofollow noopener\" target=\"_blank\">Young people turn to AI for therapy over long NHS waiting lists<\/a><\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">Limbic has taken a different approach: it works directly with health authorities. The system starts by taking a person\u2019s details, and then asks a series of questions to identify the likely issue from which they are suffering in order to book them in with an appropriate professional. It can then also provide basic therapeutic chat, relying on clinical reasoning systems grounded in industry best practice.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">The early results are promising. When Limbic is the front door, 15 per cent more people end up finishing the intake process and getting the right care. \u201cYou see an even bigger uplift for individuals from minority demographics,\u201d Harper added \u2014 perhaps because, for some, talking to a bot as a first step is less daunting than asking a human for help.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">Even when the absolute best care is delivered, however, sometimes things end badly. And when that care is administered by an algorithm rather than a human, the scrutiny will be immense. This is where, Harper reckons, he has the advantage. Limbic did not get certified as a medical device until 2023 \u2014 five years after its 2018 launch. It was an arduous process that involved building a clinical reasoning system from the ground up. So if or when something goes badly and an inquest is called, Harper said, \u201canyone can lift the hood and understand what the system did and why, and see that it was protocol adherent.\u201d <\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">Explaining its workings is critical to gaining regulatory approval, much in the same way the producer of a pacemaker must be able to explain the finer points of its devices. And that is something most self-branded \u201ctherapy\u201d bots cannot do.<\/p>\n<p class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">Last month, Slingshot AI, a two-year-old start-up, announced a $93 million funding round and the launch of Ash, \u201cthe first AI designed for therapy\u201d. The New York company, however, issued a rather large caveat: do not trust everything Ash tells you.<\/p>\n<p id=\"last-paragraph\" class=\"responsive__Paragraph-sc-1pktst5-0 gaEeqC\">\u201cAsh is an AI \u2014 a relatively new technology \u2014 and it can make mistakes. Ash can hallucinate, forget critical bits of information, or share ideas that are (frankly) bad ideas,\u201d reads a safety warning on its website. \u201cWe know that in the context of mental health, sometimes mistakes can cause real harm. That\u2019s why it\u2019s important that our users are aware of Ash\u2019s limitations, and that they can use reasonable judgment as they absorb Ash\u2019s suggestions and perspectives.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Ross Harper lives in fear. Not for his London start-up Limbic, Britain\u2019s first \u2014 and only \u2014 clinically&hellip;\n","protected":false},"author":2,"featured_media":92361,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[60],"tags":[97,259,260],"class_list":{"0":"post-92360","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-mental-health","8":"tag-health","9":"tag-mental-health","10":"tag-mentalhealth"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/92360","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=92360"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/92360\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/92361"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=92360"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=92360"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=92360"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}