{"id":189195,"date":"2025-09-29T06:04:07","date_gmt":"2025-09-29T06:04:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/189195\/"},"modified":"2025-09-29T06:04:07","modified_gmt":"2025-09-29T06:04:07","slug":"regulators-struggle-to-keep-up-with-the-complicated-landscape-of-ai-therapy-apps","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/189195\/","title":{"rendered":"Regulators struggle to keep up with the complicated landscape of AI therapy apps"},"content":{"rendered":"

In the absence of stronger federal regulation, some states have begun regulating apps that offer AI \u201ctherapy\u201d as more people turn to artificial intelligence for mental health advice<\/a>. <\/p>\n

But the laws, all passed this year, don’t fully address the fast-changing landscape of AI software development. And app developers, policymakers and mental health advocates say the resulting patchwork of state laws isn’t enough to protect users or hold the creators of harmful technology accountable.<\/p>\n

\u201cThe reality is millions of people are using these tools and they\u2019re not going back,\u201d said Karin Andrea Stephan, CEO and co-founder of the mental health chatbot app Earkick.<\/p>\n

___<\/p>\n

EDITOR\u2019S NOTE \u2014 This story includes discussion of suicide. If you or someone you know needs help, the national suicide and crisis lifeline in the U.S. is available by calling or texting 988. There is also an online chat at 988lifeline.org.<\/p>\n

___<\/p>\n

The state laws take different approaches. Illinois<\/a> and Nevada<\/a> have banned the use of AI to treat mental health. Utah<\/a> placed certain limits on therapy chatbots, including requiring them to protect users\u2019 health information and to clearly disclose that the chatbot isn\u2019t human. Pennsylvania<\/a>, New Jersey<\/a> and California<\/a> are also considering ways to regulate AI therapy.<\/p>\n

The impact on users varies. Some apps have blocked access in states with bans. Others say they’re making no changes as they wait for more legal clarity. <\/p>\n

And many of the laws don’t cover generic chatbots like ChatGPT<\/a>, which are not explicitly marketed for therapy but are used by an untold number of people for it. Those bots have attracted lawsuits in horrific instances where users lost their grip on reality<\/a> or took their own lives<\/a> after interacting with them.<\/p>\n

Vaile Wright, who oversees health care innovation at the American Psychological Association, agreed that the apps could fill a need, noting a nationwide shortage of mental health providers<\/a>, high costs for care and uneven access for insured patients.<\/p>\n

Mental health chatbots that are rooted in science, created with expert input and monitored by humans could change the landscape, Wright said.<\/p>\n

\u201cThis could be something that helps people before they get to crisis,\u201d she said. \u201cThat\u2019s not what\u2019s on the commercial market currently.\u201d<\/p>\n

That’s why federal regulation and oversight is needed, she said.<\/p>\n

Earlier this month, the Federal Trade Commission announced it was opening inquiries into seven AI chatbot companies<\/a> \u2014 including the parent companies of Instagram and Facebook, Google, ChatGPT, Grok (the chatbot on X), Character.AI and Snapchat \u2014 on how they “measure, test and monitor potentially negative impacts of this technology on children and teens.\u201d And the Food and Drug Administration is convening an advisory committee Nov. 6 to review generative AI-enabled mental health devices<\/a>.<\/p>\n

Federal agencies could consider restrictions on how chatbots are marketed, limit addictive practices, require disclosures to users that they are not medical providers, require companies to track and report suicidal thoughts, and offer legal protections for people who report bad practices by companies, Wright said.<\/p>\n

From “companion apps\u201d to \u201cAI therapists\u201d to \u201cmental wellness\u201d apps, AI\u2019s use in mental health care is varied and hard to define, let alone write laws around. <\/p>\n

That has led to different regulatory approaches. Some states, for example, take aim at companion apps<\/a> that are designed just for friendship<\/a>, but don’t wade into mental health care. The laws in Illinois and Nevada ban products that claim to provide mental health treatment outright, threatening fines up to $10,000 in Illinois and $15,000 in Nevada. <\/p>\n

But even a single app can be tough to categorize.<\/p>\n

Earkick’s Stephan said there is still a lot that is \u201cvery muddy\u201d about Illinois’ law, for example, and the company has not limited access there.<\/p>\n

Stephan and her team initially held off calling their chatbot, which looks like a cartoon panda, a therapist. But when users began using the word in reviews, they embraced the terminology so the app would show up in searches.<\/p>\n

Last week, they backed off using therapy and medical terms again. Earkick\u2019s website described its chatbot as \u201cYour empathetic AI counselor, equipped to support your mental health journey,\u201d but now it\u2019s a \u201cchatbot for self care.\u201d <\/p>\n

Still, \u201cwe\u2019re not diagnosing,\u201d Stephan maintained. <\/p>\n

Users can set up a \u201cpanic button\u201d to call a trusted loved one if they are in crisis and the chatbot will “nudge\u201d users to seek out a therapist if their mental health worsens. But it was never designed to be a suicide prevention app, Stephan said, and police would not be called if someone told the bot about thoughts of self-harm.<\/p>\n

Stephan said she’s happy that people are looking at AI with a critical eye, but worried about states’ ability to keep up with innovation.<\/p>\n

“The speed at which everything is evolving is massive,\u201d she said.<\/p>\n

Other apps blocked access immediately. When Illinois users download the AI therapy app Ash, a message urges them to email their legislators, arguing \u201cmisguided legislation\u201d has banned apps like Ash “while leaving unregulated chatbots it intended to regulate free to cause harm.\u201d<\/p>\n

A spokesperson for Ash did not respond to multiple requests for an interview.<\/p>\n

Mario Treto Jr., secretary of the Illinois Department of Financial and Professional Regulation, said the goal was ultimately to make sure licensed therapists were the only ones doing therapy.<\/p>\n

\u201cTherapy is more than just word exchanges,\u201d Treto said. “It requires empathy, it requires clinical judgment, it requires ethical responsibility, none of which AI can truly replicate right now.\u201d<\/p>\n

In March, a Dartmouth University-based team published the first known randomized clinical trial<\/a> of a generative AI chatbot for mental health treatment.<\/p>\n

The goal was to have the chatbot, called Therabot, treat people diagnosed with anxiety, depression or eating disorders. It was trained on vignettes and transcripts written by the team to illustrate an evidence-based response. <\/p>\n

The study found users rated Therabot similar to a therapist and had meaningfully lower symptoms after eight weeks compared with people who didn’t use it. Every interaction was monitored by a human who intervened if the chatbot\u2019s response was harmful or not evidence-based.<\/p>\n

Nicholas Jacobson, a clinical psychologist whose lab is leading the research, said the results showed early promise but that larger studies are needed to demonstrate whether Therabot works for large numbers of people.<\/p>\n

\u201cThe space is so dramatically new that I think the field needs to proceed with much greater caution that is happening right now,\u201d he said.<\/p>\n

Many AI apps are optimized for engagement and are built to support everything users say, rather than challenging peoples\u2019 thoughts the way therapists do. Many walk the line of companionship and therapy, blurring intimacy boundaries therapists ethically would not. <\/p>\n

Therabot\u2019s team sought to avoid those issues.<\/p>\n

The app is still in testing and not widely available. But Jacobson worries about what strict bans will mean for developers taking a careful approach. He noted Illinois had no clear pathway to provide evidence that an app is safe and effective. <\/p>\n

\u201cThey want to protect folks, but the traditional system right now is really failing folks,\u201d he said. \u201cSo, trying to stick with the status quo is really not the thing to do.\u201d<\/p>\n

Regulators and advocates of the laws say they are open to changes. But today’s chatbots are not a solution to the mental health provider shortage, said Kyle Hillman, who lobbied for the bills in Illinois and Nevada through his affiliation with the National Association of Social Workers.<\/p>\n

\u201cNot everybody who’s feeling sad needs a therapist,\u201d he said. But for people with real mental health issues or suicidal thoughts, “telling them, \u2018I know that there\u2019s a workforce shortage but here’s a bot’ \u2014 that is such a privileged position.\u201d<\/p>\n

___<\/p>\n

The Associated Press Health and Science Department receives support from the Howard Hughes Medical Institute\u2019s Department of Science Education and the Robert Wood Johnson Foundation. The AP is solely responsible for all content.<\/p>\n","protected":false},"excerpt":{"rendered":"In the absence of stronger federal regulation, some states have begun regulating apps that offer AI \u201ctherapy\u201d as…\n","protected":false},"author":2,"featured_media":189196,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[110569,182,966,181,507,46188,793,3132,97,11382,259,37229,7271,74,795],"class_list":{"0":"post-189195","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-110569","9":"tag-ai","10":"tag-article","11":"tag-artificial-intelligence","12":"tag-artificialintelligence","13":"tag-food-safety","14":"tag-general-news","15":"tag-government-regulations","16":"tag-health","17":"tag-information-technology","18":"tag-mental-health","19":"tag-psychotherapy","20":"tag-software","21":"tag-technology","22":"tag-u-s-news"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/189195","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=189195"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/189195\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/189196"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=189195"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=189195"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=189195"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}