{"id":16737,"date":"2025-09-11T21:37:09","date_gmt":"2025-09-11T21:37:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/16737\/"},"modified":"2025-09-11T21:37:09","modified_gmt":"2025-09-11T21:37:09","slug":"ftc-launches-inquiry-into-ai-chatbots-acting-as-companions-their-effects-on-children","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/16737\/","title":{"rendered":"FTC launches inquiry into AI chatbots acting as companions, their effects on children"},"content":{"rendered":"<p class=\"EkqkG IGXmU nlgHS yuUao MvWXB TjIXL aGjvy ebVHC \">The Federal Trade Commission has launched an inquiry into several social media and artificial intelligence companies about the potential harms to children and teenagers who use their AI chatbots as companions.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">The FTC said Thursday it has sent letters to Google parent Alphabet, Facebook and Instagram parent Meta Platforms, Snap, Character Technologies, ChatGPT maker OpenAI and xAI. <\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">The FTC said it wants to understand what steps, if any, companies have taken to evaluate the safety of their chatbots when acting as companions, to limit the products\u2019 use by and potential negative effects on children and teens, and to apprise users and parents of the risks associated with the chatbots.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">EDITOR\u2019S NOTE \u2014 This story includes discussion of suicide. If you or someone you know needs help, the national suicide and crisis lifeline in the U.S. is available by calling or texting 988.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">The move comes as a <a class=\"zZygg UbGlr iFzkS qdXbA WCDhQ DbOXS tqUtK GpWVU iJYzE \" data-testid=\"prism-linkbase\" href=\"https:\/\/apnews.com\/article\/ai-companion-generative-teens-mental-health-9ce59a2b250f3bd0187a717ffa2ad21f\" rel=\"nofollow noopener\" target=\"_blank\">growing number of kids use AI chatbots<\/a> for everything \u2014 from homework help to personal advice, emotional support and everyday decision-making. That&#8217;s despite research on the harms of chatbots, which have been shown to give <a class=\"zZygg UbGlr iFzkS qdXbA WCDhQ DbOXS tqUtK GpWVU iJYzE \" data-testid=\"prism-linkbase\" href=\"https:\/\/apnews.com\/article\/chatgpt-study-harmful-advice-teens-c569cddf28f1f33b36c692428c2191d4\" rel=\"nofollow noopener\" target=\"_blank\">kids dangerous advice<\/a> about topics such as drugs, alcohol and eating disorders. The mother of a teenage boy in Florida who killed himself after developing what she described as an emotionally and sexually abusive relationship with a chatbot has filed a wrongful death <a class=\"zZygg UbGlr iFzkS qdXbA WCDhQ DbOXS tqUtK GpWVU iJYzE \" data-testid=\"prism-linkbase\" href=\"https:\/\/apnews.com\/article\/chatbot-ai-lawsuit-suicide-teen-artificial-intelligence-9d48adc572100822fdbc3c90d1456bd0\" rel=\"nofollow noopener\" target=\"_blank\">lawsuit against Character.AI<\/a>. And the parents of 16-year-old Adam Raine recently sued OpenAI and its CEO Sam Altman, alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Character.AI said it is looking forward to \u201ccollaborating with the FTC on this inquiry and providing insight on the consumer AI industry and the space\u2019s rapidly evolving technology.\u201d <\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">\u201cWe have invested a tremendous amount of resources in Trust and Safety, especially for a startup. In the past year we\u2019ve rolled out many substantive safety features, including an entirely new under-18 experience and a Parental Insights feature,\u201d the company said. \u201cWe have prominent disclaimers in every chat to remind users that a Character is not a real person and that everything a Character says should be treated as fiction.\u201d<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Meta declined to comment on the inquiry and Alphabet, Snap, OpenAI and X.AI did not immediately respond to messages for comment. <\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">OpenAI and Meta earlier this month announced <a class=\"zZygg UbGlr iFzkS qdXbA WCDhQ DbOXS tqUtK GpWVU iJYzE \" data-testid=\"prism-linkbase\" href=\"https:\/\/apnews.com\/article\/ai-chatbots-teens-chatgpt-meta-instagram-whatsapp-6bdac74b06b27aa124bba73f957a6308\" rel=\"nofollow noopener\" target=\"_blank\">changes to how their chatbots respond to teenagers<\/a> asking questions about suicide or showing signs of mental and emotional distress. OpenAI said it is <a class=\"zZygg UbGlr iFzkS qdXbA WCDhQ DbOXS tqUtK GpWVU iJYzE \" data-testid=\"prism-linkbase\" href=\"https:\/\/openai.com\/index\/building-more-helpful-chatgpt-experiences-for-everyone\/\" rel=\"nofollow noopener\" target=\"_blank\">rolling out new controls<\/a> enabling parents to link their accounts to their teen\u2019s account.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Parents can choose which features to disable and \u201creceive notifications when the system detects their teen is in a moment of acute distress,\u201d according to a company blog post that says the changes will go into effect this fall.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Regardless of a user\u2019s age, the company says its chatbots will attempt to redirect the most distressing conversations to more capable AI models that can provide a better response.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC eTIW sUzSN \">Meta also said it is now blocking its chatbots from talking with teens about self-harm, suicide, disordered eating and inappropriate romantic conversations, and instead directs them to expert resources. Meta already offers parental controls on teen accounts.<\/p>\n","protected":false},"excerpt":{"rendered":"The Federal Trade Commission has launched an inquiry into several social media and artificial intelligence companies about the&hellip;\n","protected":false},"author":2,"featured_media":16738,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[18643,365,1763,363,364,138,1202,111,139,69,1414,145,672],"class_list":["post-16737","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-18643","tag-ai","tag-article","tag-artificial-intelligence","tag-artificialintelligence","tag-business","tag-information-technology","tag-new-zealand","tag-newzealand","tag-nz","tag-social-media","tag-technology","tag-teens"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/16737","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=16737"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/16737\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/16738"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=16737"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=16737"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=16737"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}