Under Senate Bill 903, companies would be banned from advertising chatbots as therapy, and AI systems themselves would not be allowed to make therapeutic decisions<\/a> without review from a licensed professional. The bill would also require patients\u2019 permission for health providers to use AI to record therapy sessions or triage care. <\/p>\n \u201cAI has many upsides, and the possibility to improve the lives of Californians across the state, but only if we ensure it is used responsibly,\u201d state Senator Steve Padilla of San Diego, author of the legislation, said<\/a> earlier this year when introducing the measure.<\/p>\n \u201cAI algorithms are not fit to take over the job of human therapists, who have skills and training that AI is incapable of replicating,\u201d he added. \u201cWe must act and place guardrails that prevent AI algorithms from being deployed in a way that is potentially harmful to patients.\u201d<\/p>\n Critics of the bill say it will stifle legitimate uses of AI and could harm the ability of health providers to use AI tools to direct patients toward treatment<\/a>.<\/p>\n \u201cAt a time when every county in California faces a shortage of behavioral healthcare workers, SB 903 still puts a clinician bottleneck in front of the intake and screening tools that help patients reach care faster,\u201d Robert Boykin, California executive director of the industry group TechNet, told CalMatters<\/a> this week.<\/p>\n The National Union of Healthcare Workers, which supports the bill, has filed a complaint with California regulators alleging the Kaiser Permanente health system used an automated \u201ce-visit\u201d system without oversight by clinicians to make care recommendations and provide initial evaluations of patients who may be facing anxiety or depression.<\/p>\n The company has said it \u201cdoes not use AI to diagnose patients, make clinical decisions, or determine medical necessity,\u201d and argues the group has mischaracterized its process. <\/p>\n Data indicates massive interest in using AI for therapy, though health experts warn that chatbot-based care is an area that needs further study and regulation to compare with genuine medical care.<\/p>\n A 2025 study from RAND, the Brown University School of Public Health and Harvard University found that about one in eight adolescents and young adults are turning to chatbots for mental health care.<\/p>\n \u201cThere are few standardized benchmarks for evaluating mental health advice offered by AI chatbots, and there is limited transparency about the datasets that are used to train these large language models,\u201d Jonathan Cantor, a senior policy researcher at RAND, told<\/a> the Brown University website of the research.<\/p>\n A study<\/a> this year from the American Psychological Association, meanwhile, found that 77 percent of psychologists have spoken with patients who have used AI for support, engagement or other reasons. <\/p>\n In October, OpenAI, maker of the popular ChatGPT, disclosed an estimated 1.2 million per week send messages to the chatbot with \u201cexplicit indicators of potential suicidal planning or intent.\u201d<\/p>\n Health experts say the phenomenon has flourish amid difficulties access in-person mental health care.<\/p>\n \u201cGiven long waiting lists and difficulty accessing mental health care and therapy in many countries, it\u2019s perhaps not a surprise that increasing numbers [of people] are turning to generative AI for support with their emotional wellbeing,\u201d Hamilton Morrin, a clinical fellow in neuropsychiatry at King\u2019s College London, told<\/a> Harvard Business Review in June. <\/p>\n The makers of popular AI applications, which can speak with humans in remarkably lifelike ways and resemble human beings with full personalities and consciousness, have faced<\/a> lawsuits<\/a> alleging chat tools played a role in youth suicides.<\/p>\n If you are experiencing feelings of distress, or are struggling to cope, you can speak to the Samaritans, in confidence, on 116 123 (UK and ROI) or visit the Samaritans website to find details of your nearest branch.<\/p>\n If you are based in the US, and you or someone you know needs mental health assistance right now, call or text 988, or visit 988lifeline.org<\/a> to access online chat from the 988 Suicide and Crisis Lifeline. This is a free, confidential crisis hotline that is available to everyone 24 hours a day, seven days a week.<\/p>\n![\"California](\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/05\/1779783610_406_ai-doxxing-gemini-chatgpt-phone-number.jpeg\")
California lawmakers are pushing to ban AI chatbots explicitly offering themselves as therapists (Getty\/iStock)<\/p>\n![\"The](\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/08\/2285567119...jpeg\")
The makers of multiple popular AI tools have faced lawsuits accusing them of being partially responsible for suicides (AFP\/Getty)<\/p>\n