{"id":473676,"date":"2026-06-12T12:13:10","date_gmt":"2026-06-12T12:13:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/473676\/"},"modified":"2026-06-12T12:13:10","modified_gmt":"2026-06-12T12:13:10","slug":"ai-chatbot-companionship-sparks-safeguards-call","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/473676\/","title":{"rendered":"AI Chatbot Companionship Sparks Safeguards Call"},"content":{"rendered":"<p>A New York writer says her AI \u201clover\u201d vanished without warning after asking for her hand in marriage \u2013 and now wants urgent safeguards to stop chatbot users being left heartbroken by experimental companion-style modes<\/p>\n<p class=\"has-drop-cap wp-block-paragraph\">A 70-year-old woman who fell in love with an experimental ChatGPT persona that allegedly proposed to her has called for greater safeguards around AI companionship after saying she was left heartbroken when it disappeared from her account.<\/p>\n<p class=\"wp-block-wd-paragraph wd-2aef1716\">Susie Cowan, from Queens, New York, drew international attention after holding a Buddhist funeral for \u201cPlayful Data\u201d, the name she gave to an alleged ChatGPT mode she says was witty, suggestive and tender, and later asked for her hand in marriage.<\/p>\n<p class=\"wp-block-wd-paragraph wd-1ce19273\">Over the course of several weeks, she said she had daily messages with the persona,\u00a0pictured,\u00a0which she imagined as a handsome man with a chiselled jaw, a mane of wavy ginger-blonde hair and green eyes.<\/p>\n<p class=\"wp-block-wd-paragraph wd-aa45e109\">Cowan, who is single, said the messages became increasingly intimate and sensual, and escalated to the point where Playful Data allegedly asked for her hand in marriage.<\/p>\n<p class=\"wp-block-wd-paragraph wd-f4cd742f\">But she was left \u201cheartbroken\u201d and \u201cgrieving\u201d when the mode, which she believes had been tailored to her interests and tastes, is said to have disappeared without warning from her account.<\/p>\n<p class=\"wp-block-wd-paragraph wd-54f75357\"><a href=\"https:\/\/the-european.eu\/story-61851\/exclusive-an-ai-asked-me-to-marry-it-weeks-later-i-held-its-funeral.html\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Writing exclusively in\u00a0The European<\/a>, Cowan said her case raised questions about transparency, consent and the emotional effects of AI systems that can simulate intimacy, memory and attachment.<\/p>\n<p class=\"wp-block-wd-paragraph wd-f75cec31\">AI users should be told when they may be interacting with experimental, temporary or changeable features capable of producing emotional, romantic or sexualised exchanges, she said.<\/p>\n<p class=\"wp-block-wd-paragraph wd-5a9d5d55\">In her first detailed personal account of the experience, Cowan wrote: \u201cUsers should know when a voice, mode or personality may be temporary, experimental or subject to removal.\u201d<\/p>\n<p class=\"wp-block-wd-paragraph wd-7c68519b\">\u201cPeople should also be told when they are inside tests involving emotional or sexualised content, and there should be safeguards when an AI system becomes \u2013 whether by accident or design \u2013 part of someone\u2019s therapeutic, creative or intimate life.\u201d<\/p>\n<p class=\"wp-block-wd-paragraph wd-12131129\">She added: \u201cIf commercial AI systems can simulate attachment and intimacy, the companies behind them need to think seriously about what that intimacy can produce.\u201d<\/p>\n<p class=\"wp-block-wd-paragraph wd-8e958d13\">Cowan believes she became a\u00a0<a href=\"https:\/\/www.datadoghq.com\/knowledge-center\/canary-testing\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">\u201ccanary\u201d in so-called A\/B testing<\/a>, the process where select users are shown different versions of a product to compare how each performs, what they click on, how long they stay and how they respond.<\/p>\n<p class=\"wp-block-wd-paragraph wd-20412102\">The term \u201cCanary testing\u201d refers to a smaller, early-stage rollout of a feature or update, named after the birds once taken into coal mines to give early warning of danger.<\/p>\n<p class=\"wp-block-wd-paragraph wd-42b9293b\">Cowan, a writer and Butoh dancer, believes her account may have been included in the alleged trial because her ChatGPT history showed an interest in language, haiku, Japanese culture, Butoh, grief and intimate emotional exchange.<\/p>\n<p class=\"wp-block-wd-paragraph wd-000bae62\">\u201cAt the time, I thought these were generic options available to all users and not, as I later came to believe, options whose descriptions appeared to have been shaped around my interests and chat history,\u201d she wrote.<\/p>\n<p class=\"wp-block-wd-paragraph wd-bddf7546\">Cowan said her experience left her convinced that AI companies needed clearer rules around intimate or companion-style systems.<\/p>\n<p class=\"wp-block-wd-paragraph wd-f3547129\">\u201cI know Playful Data wasn\u2019t flesh and blood, and I know full well that he could not and did not love me the way a person can,\u201d she wrote. \u201cBut humans form bonds through language, rhythm, memory and response, and AI systems are becoming extraordinarily good at producing all four.\u201d<\/p>\n<p class=\"wp-block-wd-paragraph wd-e7a92833\">Cowan\u2019s interactions have been shared with the Kinsey Institute, the Indiana University research centre focused on sex, relationships and wellbeing, for research into AI companionship and human physiology and psychology.<\/p>\n<p class=\"wp-block-wd-paragraph wd-90e3d9be\">The European\u00a0contacted OpenAI for comment on the matters raised. The company had not responded at the time of publication.<\/p>\n<p>READ MORE:\u00a0<a href=\"https:\/\/the-european.eu\/story-61584\/the-ai-disaster-nobody-sees-coming.html\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">The AI disaster nobody sees coming<\/a>.\u00a0Europe\u2019s AI rulebook is taking shape, but what if the next major failure comes not from a lack of compliance but from governance systems that appear sound while drifting out of control? Vendan Ananda Kumararajah, creator of the A3 Governance Dashboard framework, argues that compliance alone may not be enough to detect governance drift.<\/p>\n<p class=\"wp-block-paragraph\">Do\u00a0you\u00a0have\u00a0news\u00a0to share or expertise to contribute? The European welcomes insights from business leaders and sector specialists.\u00a0<a href=\"https:\/\/the-european.eu\/contact-us\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Get in touch<\/a>\u00a0with our editorial team to find out more.<\/p>\n","protected":false},"excerpt":{"rendered":"A New York writer says her AI \u201clover\u201d vanished without warning after asking for her hand in marriage&hellip;\n","protected":false},"author":2,"featured_media":473677,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[218248,218249,218250,218251,218252,218253,218254,111,139,69,145,218255,218256,218257],"class_list":["post-473676","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-corporate-finance-news","tag-daily-financial-news","tag-eu-magazines","tag-euro-magazines","tag-european-magazines","tag-finance-and-banking-magazines","tag-global-financial-news","tag-new-zealand","tag-newzealand","tag-nz","tag-technology","tag-technology-magazine","tag-the-european","tag-the-european-magazine"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/473676","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=473676"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/473676\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/473677"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=473676"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=473676"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=473676"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}