{"id":251975,"date":"2025-10-30T23:50:16","date_gmt":"2025-10-30T23:50:16","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/251975\/"},"modified":"2025-10-30T23:50:16","modified_gmt":"2025-10-30T23:50:16","slug":"character-ai-to-ban-teens-from-talking-to-its-ai-chatbots","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/251975\/","title":{"rendered":"Character.ai to ban teens from talking to its AI chatbots"},"content":{"rendered":"<p class=\"sc-9a00e533-0 eZyhnA\">Chatbot site Character.ai is cutting off teenagers from having conversations with virtual characters, after facing intense criticism over the kinds of interactions young people were having with online companions.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">The platform, founded in 2021, is used by millions to talk to chatbots powered by artificial intelligence (AI).<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">But it is facing several lawsuits in the US from parents, including one over the death of a teenager, with some branding it a &#8220;<a target=\"_self\" href=\"https:\/\/www.bbc.co.uk\/news\/articles\/cd605e48q1vo\" class=\"sc-f9178328-0 iCaRzc\" rel=\"nofollow noopener\">clear and present danger<\/a>&#8221; to young people.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Now, Character.ai says from 25 November under-18s will only be able to generate content such as videos with their characters, rather than talk to them as they can currently.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Online safety campaigners have welcomed the move but said the feature should never have been available to children in the first place.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Character.ai said it was making the changes after &#8220;reports and feedback from regulators, safety experts, and parents&#8221;, which have highlighted concerns about its chatbots&#8217; interactions with teens.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Experts have previously warned the potential for AI chatbots to make things up, be overly-encouraging, and feign empathy can pose risks to young and vulnerable people.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;Today&#8217;s announcement is a continuation of our general belief that we need to keep building the safest AI platform on the planet for entertainment purposes,&#8221; Character.ai boss Karandeep Anand told BBC News.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">He said AI safety was &#8220;a moving target&#8221; but something the company had taken an &#8220;aggressive&#8221; approach to, with <a target=\"_self\" href=\"https:\/\/www.bbc.co.uk\/news\/articles\/c62zgd3kk50o\" class=\"sc-f9178328-0 iCaRzc\" rel=\"nofollow noopener\">parental controls and guardrails<\/a>.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Online safety group Internet Matters welcomed the announcement, but it said safety measures should have been built in from the start.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;Our own research shows that children are exposed to harmful content and put at risk when engaging with AI, including AI chatbots,&#8221; it said.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Character.ai has been criticised in the past for hosting potentially harmful or offensive chatbots that children could talk to.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Avatars impersonating British teenagers Brianna Ghey, who was murdered in 2023, and Molly Russell, who took her life at the age of 14 after viewing suicide material online, were <a target=\"_self\" href=\"https:\/\/www.bbc.co.uk\/news\/articles\/cg57yd0jr0go\" class=\"sc-f9178328-0 iCaRzc\" rel=\"nofollow noopener\">discovered on the site in 2024<\/a> before being taken down.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Later, in 2025, the Bureau of Investigative Journalism (TBIJ) found a chatbot based on paedophile Jeffrey Epstein which had logged more than 3,000 chats with users.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\"><a target=\"_blank\" href=\"https:\/\/www.thebureauinvestigates.com\/stories\/2025-10-22\/gang-leaders-school-shooters-and-bestie-epstein-meet-character.ais-chatbot-companions\" class=\"sc-f9178328-0 iCaRzc\" rel=\"nofollow noopener\">The outlet reported<\/a> the &#8220;Bestie Epstein&#8221; avatar continued to flirt with its reporter after they said they were a child. It was one of several bots flagged by TBIJ that were subsequently taken down by Character.ai.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">The Molly Rose Foundation &#8211; which was set up in memory of Molly Russell &#8211; questioned the platform&#8217;s motivations.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;Yet again it has taken sustained pressure from the media and politicians to make a tech firm do the right thing, and it appears that Character AI is choosing to act now before regulators make them,&#8221; said Andy Burrows, its chief executive.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Mr Anand said the company&#8217;s new focus was on providing &#8220;even deeper gameplay [and] role-play storytelling&#8221; features for teens &#8211; adding these would be &#8220;far safer than what they might be able to do with an open-ended bot&#8221;.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">New age verification methods will also come in, and the company will fund a new AI safety research lab.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Social media expert Matt Navarra said it was a &#8220;wake-up call&#8221; for the AI industry, which is moving &#8220;from permissionless innovation to post-crisis regulation&#8221;.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;When a platform that builds a teen experience still then pulls the plug, it&#8217;s saying that filtered chats aren&#8217;t enough when the tech&#8217;s emotional pull is strong,&#8221; he told BBC News.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;This isn&#8217;t about content slips. It&#8217;s about how AI bots mimic real relationships and blur the lines for young users,&#8221; he added.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Mr Navarra also said the big challenge for Character.ai will be to create an engaging AI platform which teens still want to use, rather than move to &#8220;less safer alternatives&#8221;.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">Meanwhile Dr Nomisha Kurian, who has researched AI safety, said it was &#8220;a sensible move&#8221; to restrict teens using chatbots.<\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\"> &#8220;It helps to separate creative play from more personal, emotionally sensitive exchanges,&#8221; she said. <\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;This is so important for young users still learning to navigate emotional and digital boundaries. <\/p>\n<p class=\"sc-9a00e533-0 eZyhnA\">&#8220;Character.ai&#8217;s new measures might reflect a maturing phase in the AI industry &#8211; child safety is increasingly being recognised as an urgent priority for responsible innovation.&#8221;<\/p>\n","protected":false},"excerpt":{"rendered":"Chatbot site Character.ai is cutting off teenagers from having conversations with virtual characters, after facing intense criticism over&hellip;\n","protected":false},"author":2,"featured_media":251976,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-251975","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/251975","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=251975"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/251975\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/251976"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=251975"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=251975"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=251975"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}