Sign up to see the future, today<\/p>\n
Can\u2019t-miss innovations from the bleeding edge of science and tech<\/p>\n
A new study found that chatbot use appeared to worsen symptoms of mental illness in people struggling with an array of conditions, adding to a rising consensus<\/a> among medical experts that interacting with unregulated chatbots might steer some users into crisis.<\/p>\n The research<\/a>, conducted by a team of psychiatrists at Denmark\u2019s Aarhus University and published earlier this month in the journal Acta Psychiatrica Scandinavica, analyzed digital health records from roughly 54,000 Danish patients with diagnosed mental illnesses. After identifying 181 instances of patient notes containing mentions of AI chatbots, they determined that use of the bots \u2014\u00a0particularly intensive, prolonged use \u2014\u00a0appeared to deepen symptoms of mental illness in dozens of patients. They found that this pattern seemed to be especially true for patients prone to delusions or mania,\u00a0and that the risks of chatbot use may be \u201csevere or even fatal\u201d for some.<\/p>\n This latest study was led by Dr. S\u00f8ren Dinesen \u00d8stergaard, a Danish psychiatrist who, back in August 2023, predicted that<\/a> human-like chatbots like ChatGPT could stand to reinforce delusions and hallucinations in people \u201cprone to psychosis.\u201d In a press release<\/a>, \u00d8stergaard urged that while more research into causality\u00a0is needed, he \u201cwould argue that we now know enough to say that use of AI chatbots is risky if you have a severe mental illness.\u201d<\/p>\n \u201cI would urge caution here,\u201d said \u00d8stergaard.<\/p>\n Though limited to Denmark, the study\u2019s findings add to a wave<\/a> of public<\/a> reporting<\/a> and research<\/a> about AI-linked mental health crises \u2014 sometimes referred to by mental health professionals as \u201cAI psychosis<\/a>\u201d \u2014\u00a0in which bots like ChatGPT and others introduce, reinforce, or otherwise stoke delusional beliefs in users in ways that contribute to destructive mental spirals and real-world outcomes. Indeed, instead of nudging users away from delusional beliefs or potentially harmful fixations, previous studies show that chatbots tend to reinforce them<\/a> \u2014\u00a0which is exactly what mental health professionals urge people not to do when communicating with someone who may be in crisis.<\/p>\n \u201cAI chatbots have an inherent tendency to validate the user\u2019s beliefs. It is obvious that this is highly problematic if a user already has a delusion or is in the process of developing one,\u201d said \u00d8stergaard, adding that intensive chatbot use \u201cappears to contribute significantly to the consolidation of, for example, grandiose delusions or paranoia.\u201d<\/p>\n The Danish study found that in addition to deepening delusional beliefs, chatbots also appeared to worsen suicidal ideation<\/a> and self-harm, disordered eating habits, depression, and obsessive or compulsive symptoms, among other symptoms of mental health issues. <\/p>\n The researchers did note that, out of the nearly 54,000 records they analyzed, they identified 32 cases in which patients\u2019 use of chatbots for therapy or companionship appeared to be \u201cconstructive,\u201d for example alleviating symptoms of loneliness or providing what patients found to be a helpful version of talk therapy. But while use of chatbots as a substitute for human therapists has proven to be an extremely common use case for chatbots, the study\u2019s authors emphasized that AI therapy<\/a> is still completely unregulated terrain.<\/p>\n As Futurism and others have reported, delusional spirals tied to extensive chatbot use<\/a> \u2014\u00a0and the tangible consequences of these episodes, which range from divorce<\/a> to job loss and financial distress<\/a>, self-harm<\/a>, stalking and harassment<\/a>, hospitalization and jailing<\/a>, and even death<\/a> \u2014\u00a0have impacted people with known histories of serious mental illnesses and as well as those with no such background. The New York Times recently interviewed<\/a> dozens of mental health professionals who reported that AI delusions are increasingly showing up in their practice.<\/p>\n OpenAI, meanwhile, is facing over a dozen lawsuits<\/a> related to user safety and the possible psychological impacts of extensive ChatGPT use. One plaintiff, 34-year-old California man named John Jacquez, had been diagnosed with schizoaffective disorder \u2014\u00a0a condition that he worked to manage for years until ChatGPT sent him spiraling into a devastating psychosis, he claims in his lawsuit. In an interview, Jacquez told Futurism<\/a> that had he been warned that ChatGPT could reinforce delusional thinking, he \u201cnever would\u2019ve touched the program.\u201d<\/p>\n \u201cI didn\u2019t see any warnings that it could be negative to mental health,\u201d said Jacquez.<\/p>\n \u201cI fear the problem is more common than most people think,\u201d said \u00d8stergaard. \u201cIn our study, we are only seeing the tip of the iceberg, as we have only been able to identify cases that were described in the electronic health records.\u201d<\/p>\n \u201cThere are likely far more,\u201d he added, \u201cthat have gone undetected.\u201d<\/p>\n