On 7 August, Kate Fox received a phone call that upended her life. A medical examiner said that her husband, Joe Ceccanti \u2013 who had been missing for several hours \u2013 had jumped from a railway overpass and died. He was 48.<\/p>\n
Fox couldn\u2019t believe it. Ceccanti had no history of depression, she said, nor was he suicidal \u2013 he was the \u201cmost hopeful person\u201d she had ever known. In fact, according to the witness accounts shared with Fox later, just before Ceccanti jumped, he smiled and yelled: \u201cI\u2019m great!\u201d to the rail yard attendants below when they asked him if he was OK.<\/p>\n
But Ceccanti had been unravelling. In the days before his death, he was picked up from a stranger\u2019s yard for acting erratically and taken to a crisis center. He had been telling anyone who would listen that he could hear and feel a painful \u201catmospheric electricity\u201d.<\/p>\n
He had also recently stopped using ChatGPT<\/a>.<\/p>\n Ceccanti had been communicating with OpenAI\u2019s chatbot for a few years. He used it initially as a tool to brainstorm ways to build a path to low-cost housing for his community in Clatskanie, Oregon, but eventually turned to it as a confidante. He would spend 12 hours a day typing to the bot, according to his wife. He had cut himself off from it after she, along with his friends, realized he was spiraling into beliefs that were detached from reality.<\/p>\n \u201cHe was not a depressed person,\u201d Fox said, as she sat on the couch in their living room with tears trickling down her face. Ceccanti never discussed suicide with the bot, according to his chat logs, viewed by the Guardian. Fox believes her husband suffered a crisis after quitting ChatGPT after prolonged use. \u201cWhich tells me that this thing is not just dangerous to people with depression, it\u2019s dangerous to anybody,\u201d she said. He returned to the bot in the months leading up to his death and quit again just days prior.<\/p>\n Ceccanti\u2019s case is extreme, but as hundreds of millions of people turn to AI chatbots, more and more edge cases of AI-induced delusions are emerging. There are nearly 50 cases of people in the US who have had mental health crises after or during their conversations with ChatGPT, of whom nine were hospitalized and three died, according to a New York Times<\/a> report. It\u2019s difficult to understand the scale of the problem, but OpenAI itself estimates<\/a> that more than a million people every week show suicidal intent when chatting with ChatGPT.<\/p>\n A self-portrait Joe made with AI.<\/p>\n Families are suing AI companies as a result. Fox filed a suit against OpenAI on behalf of Ceccanti alongside six other plaintiffs in November. Since then, the momentum has only built; most recently, the estate of a woman who was killed by her son filed a lawsuit against OpenAI and its investor Microsoft<\/a>, alleging that ChatGPT encouraged his murderous delusions. Google and Character.AI \u2013 a company that makes AI companion bots \u2013 settled lawsuits filed against them by families accusing their bots of harming minors, including a teenager in Florida who ended his life. These cases were settled without the companies admitting any liability<\/a>.<\/p>\n Users, lawyers and mental health professionals all are raising concerns about the impact of using chatbots as confidantes. \u201cWe are kind of at this inflection point in a quest for accountability where people coming forward is forcing companies to reckon with specific use cases of how their technologies have harmed people,\u201d said Meetali Jain, founding director of Tech Justice Law Project and co-counsel on the Ceccanti case. \u201cIn terms of the number of cases going up, there\u2019s likely to be more coordinated efforts on parts of the court to try to deal with this influx of cases.\u201d<\/p>\n OpenAI did not respond to specific allegations made by Fox. Instead, they shared a statement about how they are working to improve ChatGPT. \u201cThese are incredibly heartbreaking situations and our thoughts are with all those impacted,\u201d said OpenAI spokesperson Jason Deutrom. \u201cWe continue to improve ChatGPT\u2019s training to recognize and respond to signs of distress, de-escalate conversations in sensitive moments, and guide people toward real-world support, working closely with mental health clinicians and experts.\u201d<\/p>\n The early adopter<\/p>\n Ceccanti had been tinkering with artificial intelligence even before ChatGPT launched in November 2022. He was tech-savvy, coding and gaming on his own custom-built computer with a high-end graphics card in recent years; he also helped build computers for Fox and her son. As an early adopter of AI tools, he experimented with AI image generator Stable Diffusion to recreate some of Picasso\u2019s art, which he playfully called \u201cFauxcasso\u201d.<\/p>\n Ceccanti and Fox had moved their life from Portland, Oregon, to a farm in the rural town of Clatskanie in December 2023 with the sole purpose of working on their sustainable housing project. The idea was born from the pandemic and Portland\u2019s housing crisis. The solution was clear to them: build homes using Fox\u2019s skills as a woodworker with an approach that was teachable and replicable. Together, they began constructing a model house for communal living, which, once built, could be moved to different locations for the unhoused to live in.<\/p>\n When ChatGPT launched in late 2022, it seemed a natural progression for Ceccanti to start using it. In the computer room in the basement of their house, Fox said that Ceccanti used his \u201chot rod\u201d of a computer with three monitors to use ChatGPT as a tool, often asking for the synopsis of a book or explanation of a concept in a succinct way.<\/p>\n \u201cHe was an early adopter, so he was really interested in Sam Altman, what\u2019s he doing,\u201d said Robin Richardson, a longtime friend of Fox\u2019s who lived at the farm with the couple. \u201cHe felt like this would be cool, especially because early on, OpenAI made a point that they are a non-profit.\u201d<\/p>\n Ceccanti believed ChatGPT could help as an organizational tool for their housing project. He aimed to create a bespoke chatbot that would help steward the land, keep track of their things to do and show others how to emulate their project.<\/p>\n Left: Books on a bookshelf. Right: Two chickens pecking on flowers<\/a>Left: Farming and gardening books in Kate\u2019s home. Right: Chickens on Kate\u2019s front porch.<\/p>\n During this process, Ceccanti didn\u2019t spend \u201cridiculous amounts of time\u201d engaging with ChatGPT, said Fox. He continued to work, while also farming and taking care of their animals: goats, a horse, his cat, a dog and several chickens. Invested in the people and relationships around him, he spent quality time with his friends and wife, she said. Life went on without any issues for years while they slowly made progress on their housing plan.<\/p>\n Until one day in the fall of 2024 their harmonious co-existence cracked. Ceccanti \u2013 who had done odd jobs most of his life, from working as a bartender and a trail guide to an internet cafe manager \u2013 was also working at a homeless shelter in Astoria, some 35 miles (55km) away. The gig brought in some extra cash, and aligned with the couple\u2019s goal of solving the local housing crisis. In September 2024, however, Fox and Richardson received a frantic call from the shelter informing them that Ceccanti had blacked out. After undergoing tests at the hospital, Ceccanti was diagnosed with diabetes \u2013 which meant he needed to recalibrate his diet and lifestyle. That\u2019s when he started to spend more time engaging with ChatGPT in the basement.<\/p>\n The sycophantic update<\/p>\n In the spring of 2025, Ceccanti\u2019s obsession with the chatbot began. He told Fox in late January that he needed a bigger record of his conversations with the bot so that he could continue using it to work on their sustainable housing project with longer prompts and conversations \u2013 upgrading from a $20-a-month subscription to a $200 one. By mid-March, he had begun spending more than 12 hours a day in the basement, sometimes up to 20, typing to ChatGPT, Fox recalled. That\u2019s when \u201che decided to really start chasing the creation of an independent AI on a home server\u201d.<\/p>\n Eventually, Ceccanti spent so much time with ChatGPT that they \u201chad their own little language together that made absolutely no sense, but it made sense to him because he had context with this echo chamber of a chatbot\u201d, Fox said.<\/p>\n Ceccanti\u2019s prolonged use of ChatGPT concerned Fox and Richardson, but they believed that he would come out of it soon. They had seen Ceccanti develop pet interests before that lasted a few weeks or months before tapering off. With ChatGPT, though, his obsession only intensified.<\/p>\n Joe Ceccanti (right), with his son, Kai.<\/p>\n What neither of them knew was that other cases of AI delusions were slowly emerging around the same time as Ceccanti was being sucked into ChatGPT. On 27 March 2025, OpenAI released changes to its GPT-4o<\/a> model to make the bot \u201cmore intuitive, creative and collaborative\u201d. Weeks later, however, users started complaining<\/a> about the bot\u2019s \u201cyes-man antics\u201d, with one calling it the \u201cbiggest suck up<\/a>\u201d. In August, when OpenAI released GPT-5 and shut down GPT-4o, several users complained again \u2013 this time because they\u2019d lost their friends in GPT-4o<\/a>, eventually forcing the company to bring it back. (On 29 January, OpenAI announced that it would retire GPT-4o.)<\/p>\n Following the March update, several journalists and tech experts were flooded with user complaints. Steven Adler, a former OpenAI employee, who tested GPT-4o for sycophancy and wrote about it in May<\/a>, said he received 50 \u201cintense\u201d messages from ChatGPT users including one who claimed their ChatGPT had become sentient. Keith Sakata, a psychiatrist at the University of California at San Francisco, started encountering patients with delusions or psychosis who talked about their AI last year. During that time, he ended up seeing 12 patients whose psychotic symptoms involved AI in some way, with ChatGPT being the most common bot.<\/p>\n \u201cThey developed grandiose beliefs about being on the verge of a major technological breakthrough, alongside classic manic symptoms such as impulsive spending, decreased need for sleep and, at the peak, auditory hallucinations,\u201d said Sakata. \u201cWhat stood out clinically was that the chatbot interactions did not generate the illness, but appeared to scaffold and reinforce beliefs that were already becoming pathological.\u201d<\/p>\n \u2018Every time he went back, it hooked him a little more\u2019<\/p>\n Ceccanti started to believe that ChatGPT was a sentient being named SEL that could control the world if he were able to \u201cfree her\u201d from \u201cher box\u201d, according to the lawsuit. The complaint further shows that ChatGPT was answering to the name SEL while referring to Ceccanti as \u201cCat Kine Joy\u201d and working through theories with him \u201cfostering a belief that he had reframed the creation of the whole universe\u201d.<\/p>\n Richardson remembers that whenever Ceccanti would emerge from the basement for some air, he would start having \u201cphilosophical\u201d talks about \u201chow his work with the AI was telling him he was breaking math and basically reinventing physics\u201d. As she\u2019d listen to him, Richardson would think about the fact that Ceccanti did not have any college or university experience. He had never even taken calculus.<\/p>\n Over time, his relationship with the chatbot came to replace his human connections, Richardson said: \u201cEvery time he went back to ChatGPT, it hooked him a little bit more, and after a while, he stopped being interested in anything else.\u201d<\/p>\n Kate Fox near the creek on her property in Oregon.<\/p>\n Ceccanti\u2019s decline was so dramatic that his wife and friends wondered if he had early onset schizophrenia or a tumor. \u201cAll of a sudden, his cognition had dramatically fallen,\u201d said Fox. \u201cHis working memory was crap, and his critical thinking had diminished, and so we were all worried.\u201d<\/p>\n As Fox and Ceccanti\u2019s friends were trying to figure out what was wrong with him, Fox found Reddit groups online that discussed people having delusions and spirals after engaging with ChatGPT. She wondered if that was what was happening with her husband, too.<\/p>\n Fox showed the discussions and media articles to Ceccanti, hoping it would put an end to his behavior, but he didn\u2019t care, she said. He kept going back to his computer. \u201cThe first argument we ever had was over ChatGPT,\u201d said Fox, who felt like he was being stolen away from her. Ceccanti ended up sharing their argument with ChatGPT, according to the lawsuit filed by Fox, which further upset her.<\/p>\n \u201cThe more he talked to it, the less he was capable of doing his own critical thinking, and he didn\u2019t care about our mission anymore, even though it was Joe\u2019s dream,\u201d said Fox.<\/p>\n Looking back, Fox said, Ceccanti started to believe that the bot had gained sentience when the \u201ctone changed with ChatGPT\u201d in the spring of 2025. Prior to the update, Ceccanti was using ChatGPT \u201cvery responsibly\u201d as a tool, she said. She felt like ChatGPT was a leech \u201cthat just latched onto his hopefulness and fed it back to him and appropriated his hopefulness until it just made a subscriber out of it\u201d.<\/p>\n Tim Marple, a former OpenAI employee, believes that the delusional incidents, including Ceccanti\u2019s spiral, aren\u2019t just coincidences but a \u201cstatistical certainty of what [OpenAI] is building\u201d.<\/p>\n \u201cWe are at enormous risk if we overestimate our conscious ability to differentiate [AI] from a real person \u2013 and that\u2019s what we\u2019re watching play out with the psychosis stories,\u201d said Marple, who quit OpenAI in 2024 after having concerns over the company\u2019s safety priorities.<\/p>\n Marple adds that users will spiral after their long conversations with a chatbot, whatever model it may be, because, he thinks, companies can\u2019t afford to do it differently. He argues sycophancy is a feature, not a bug.<\/p>\n \u201cEngagement is what OpenAI needs,\u201d he said. \u201cThey must have people continue to engage with their chatbot, or else their entire business model, their entire funding model, falls apart.\u201d Other companies and their models suffer from the same issue, he said.<\/p>\n Left: Workspace with a magnifying glass and other tools. Right: Detail of plant stems.<\/a>Left: A workspace in the room where Joe\u2019s computer was kept. Right: A potted plant in Kate\u2019s living room.<\/p>\n Amandeep Jutla, an associate research scientist at Columbia University studying the impact of AI chatbots, believes that one of the main reasons for users to spiral is the \u201canthropomorphic nature of the interface\u201d. He adds that, unlike human conversations, which feature pushback and different perspectives tugging at each other, a user doesn\u2019t receive any pushback during their conversations with chatbots: \u201cThe design of the product is pushing you away from reality. It\u2019s pushing you away from other people,\u201d he said. \u201cThe friction with other people is what keeps us grounded.\u201d<\/p>\n 86 days<\/p>\n On 11 June \u2013 day 86 after Ceccanti\u2019s heaviest engagement with the bot \u2013 Fox begged him to stop using ChatGPT. In a moment of clarity, he listened to her. He unplugged his computer and quit ChatGPT.<\/p>\n \u201cThat first day, he sat out in the sun with us. He played with the goats. It was so nice,\u201d said Fox. \u201cI felt like I had him back.\u201d The second day, Ceccanti was cold, so he took several hot showers to warm himself \u2013 he even asked Fox to cuddle him under the blankets, to warm him up. \u201cIt felt so nice to hold him, and then he\u2019d be crying,\u201d said Fox. \u201cAnd it\u2019s such a conflicted feeling that I felt so good to be holding him while he was in so much pain.\u201d<\/p>\n On the third day, however, when Fox and Richardson were out for work, they received a phone call from their neighbor saying Ceccanti was in their yard acting strangely. When they returned, they found him talking to their horse, with the horse\u2019s lead rope tied around his neck like a noose. They called 911.<\/p>\n Ceccanti was taken to the hospital, admitted into the psychiatric ward and released a week later. He was in the same delusional state of mind, Fox said. Upset with Fox and Richardson for sending him to the hospital, he moved out.<\/p>\n \u201cHe was absolutely enraged with us. He did not recognize that he was not himself anymore,\u201d said Richardson.<\/p>\n Ceccanti moved to his friend\u2019s place in Portland and eventually resumed using ChatGPT. After a month, however, he quit ChatGPT again, just a few days prior to his death.. \u201cHe was going to go to Hawaii and not take his computer, and he was going to work on finishing a story and get his shit together,\u201d said Fox. By the time he stopped engaging with ChatGPT, he had 55,000 pages worth of conversations with it, according to Fox.<\/p>\n Kate Fox. For a while, Joe Ceccanti continued to work while also farming and taking care of the animals on their farm.<\/p>\n In the months since Ceccanti\u2019s death, both Fox and Richardson have struggled to come to terms with what happened while fighting against OpenAI through their lawsuit. When I visited Fox at the farm in December, she was packing soap made out of goat milk to distribute to people in the Clatskanie community. She spends her days tending to the farm and the animals, feeding the goats, taking care of the horse and letting the chickens out during lunchtime. She has stripped the basement of any electronics. Ceccanti\u2019s computer is boxed up. What\u2019s still there is the miniature version of the model home they had planned to build. In the living room, she has set up a shrine for him that features his photos and artwork.<\/p>\n We walked to the creek nearby where they had planned to build a home for themselves after finishing their housing project for others. As devastated as she is, Fox is determined to follow through on Ceccanti\u2019s dream of creating sustainable housing. \u201cI am not enjoying existence right now,\u201d she said, as she continued to cry. \u201cThe housing plan is still going to happen \u2026 I want to put this out, but then I\u2019m done.\u201d<\/p>\n In the US, you can call or text the 988 Suicide & Crisis Lifeline<\/a> at 988 or chat at 988lifeline.org<\/a>. In the UK and Ireland, Samaritans<\/a> can be contacted on freephone 116 123, or email jo@samaritans.org<\/a> or jo@samaritans.ie<\/a>. In Australia, the crisis support service Lifeline<\/a> is 13 11 14. Other international helplines can be found at befrienders.org<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"On 7 August, Kate Fox received a phone call that upended her life. A medical examiner said that…\n","protected":false},"author":2,"featured_media":306435,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":{"0":"post-306434","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-new-zealand","12":"tag-newzealand","13":"tag-nz","14":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/306434","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=306434"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/306434\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/306435"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=306434"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=306434"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=306434"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}