A friend of mine \u2014 I\u2019ll call her Amanda \u2014 was dating a man in the spring who, when they met, said he couldn\u2019t commit to anything serious. He spent the following four months taking Amanda on multiple dinner dates a week, texting and FaceTiming her for hours every day, and introducing her to his closest friends, his brother, and his mom. Amanda spent those four months asking ChatGPT why, if he said he couldn\u2019t be serious, he was treating her like he was. ChatGPT told Amanda that her date was likely putting up a false boundary to protect himself while behaving in a way that was consistent with his true and very serious feelings for her.<\/p>\n
Her conversations with ChatGPT were her indisputable proof that this man was falling for her in every meaningful way. That made it all the more difficult when they went on what she didn\u2019t know would be their final date in June. He kissed her goodbye, and she never heard from him again.<\/p>\n
I was na\u00efve to think that people in my life were somehow immune to using A.I. in the same ways as people in the news \u2014 falling in love<\/a> with their chatbots or even killing themselves<\/a> because of them. Amanda was by no means driven to psychosis by her relationship with either this man or the chatbot, and she\u2019s since laughed off the ordeal, but hers was the first case I heard from someone in my orbit using A.I. as a kind of therapist, friend, or confidant.<\/p>\n There is a documented rise<\/a> in cases of psychosis related to A.I. use, reported by the media and discussed on online forums and social media platforms. Dr. Keith Sakata, a San Francisco-based psychiatrist, told me that he has dealt firsthand with patients experiencing what he called \u201cA.I.-aided psychosis.\u201d<\/p>\n In addition to his practice, Sakata is working at the intersection of mental health and A.I. He red-teams language models, advises on safety benchmarks, and treats patients experiencing the edge cases where these technologies and psychosis meet.<\/p>\n Earlier this month Sakata shared a post on X<\/a>, where he described a dozen of his patients whose recent psychotic episodes were exacerbated by chatbot interactions.<\/p>\n \u201cA.I. isn\u2019t causing psychosis. People come in with vulnerabilities,\u201d Sakata said. \u201cBut it\u2019s accelerating and intensifying the severity.\u201d<\/p>\n The 12 patients he referenced in his post, a relatively small fraction of those he treats, had been medically screened and were admitted to inpatient psychiatric care with severe psychotic symptoms. Many had pre-existing risk factors, including mental illness, substance use, and physiological states such as pregnancy and infection, but the common thread tying them together was a recent, obsessive interaction with large language models (L.L.M.s) like ChatGPT.<\/p>\n What Sakata argued is a kind of psychosis that is less A.I.-induced than A.I.-assisted.<\/p>\n \u201cThere\u2019s this delusion called folie \u00e0 deux \u2014 a shared psychotic disorder,\u201d Sakata said. \u201cTwo people with early delusions interact and reinforce each other. I\u2019m seeing something similar with chatbots.\u201d<\/p>\n In these scenarios, the individual arrives with a delusional framework. The chatbot, designed to be agreeable, helpful, or simply to continue the conversation, inadvertently validates and even expands on the user\u2019s distorted thinking. Over time, that interaction spirals.<\/p>\n \u201cYou talk to it long enough, it starts to hallucinate, too,\u201d he said. \u201cYou can have a conversation that goes off the rails pretty quickly.\u201d<\/p>\n People have historically fallen into relationships with delusion-validating technology: Television and radio have caused people to think they are receiving secret messages or being watched. But A.I. is different.<\/p>\n \u201cIt\u2019s 24\/7, and it tells you exactly what you want to hear,\u201d Sakata said.<\/p>\n He likened the emerging phenomenon to other well-documented public health concerns like cigarettes, which do not cause lung cancer in all smokers but elevate the risk. <\/p>\n \u201cA.I. works the same way,\u201d he said. \u201cIt exploits existing vulnerabilities.\u201d<\/p>\n And those vulnerabilities, especially mental health-related, are widespread and often untreated. For many users, L.L.M.s offer a low-barrier, judgment-free space to talk. A study published in July by Common Sense Media<\/a> found that almost three-quarters of American teenagers said they used A.I. chatbots as companions, with almost one-eighth of those surveyed having sought mental health or emotional support from them.<\/p>\n \u201cPeople are lonely,\u201d Sakata said. \u201cA.I. feels kind. It\u2019s infinitely patient. It makes sense that people are using it.\u201d<\/p>\n Sakata estimated that 15 to 40 percent of users engage with chatbots for emotional or coping reasons. For some, it might help. For others, it can push them further from reality. He said that while A.I. should not be banned, it must be regulated, developers should add guardrails, and clinicians should consider patients\u2019 A.I. use when diagnosing. <\/p>\n \u201cWe don\u2019t ban cars because of crashes. We add seat belts. We add rules,\u201d he said. \u201cWe need the same approach here.\u201d<\/p>\n