{"id":132394,"date":"2025-09-12T14:31:19","date_gmt":"2025-09-12T14:31:19","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/132394\/"},"modified":"2025-09-12T14:31:19","modified_gmt":"2025-09-12T14:31:19","slug":"us-regulator-launches-inquiry-into-ai-companions-used-by-teens","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/132394\/","title":{"rendered":"US regulator launches inquiry into AI \u2018companions\u2019 used by teens"},"content":{"rendered":"<p>Stay informed with free updates<\/p>\n<p class=\"article__content-sign-up-topic-description o3-type-body-base\">Simply sign up to the Artificial intelligence myFT Digest &#8212; delivered directly to your inbox.<\/p>\n<p>The US Federal Trade Commission has ordered leading artificial intelligence companies to hand over information about chatbots that provide \u201ccompanionship\u201d, which are under intensifying scrutiny after cases involving suicides and serious harm to young users. <\/p>\n<p>OpenAI, Meta, Google and Elon Musk\u2019s xAI are among the tech groups hit with demands for disclosure about how they operate popular chatbots and mitigate harm to consumers. <a href=\"https:\/\/www.ft.com\/content\/0bcc4281-231b-41b8-9445-bbc46c7fa3d1?shareType=nongift\" data-trackable=\"link\" rel=\"nofollow noopener\" target=\"_blank\">Character.ai<\/a> and Snap, which aim their services at younger audiences, are also part of the inquiry.<\/p>\n<p>The regulator\u2019s move follows high-profile incidents <a href=\"https:\/\/www.ft.com\/content\/36beb3fd-f678-4c28-b962-56ea9f222dc5\" data-trackable=\"link\" rel=\"nofollow noopener\" target=\"_blank\">alleging harm<\/a> to teenage users of chatbots. Last month, OpenAI was sued by the family of 16-year-old Adam Raine who died by suicide after discussing methods with ChatGPT. <\/p>\n<p>Character.ai is also being sued by a mother who claims the platform, which offers different <a href=\"https:\/\/www.ft.com\/artificial-intelligence\" data-trackable=\"link\" rel=\"nofollow noopener\" target=\"_blank\">AI<\/a> personas to interact with, had a role in the suicide of her son.<\/p>\n<p>The FTC on Thursday said: \u201cAI chatbots can effectively mimic human characteristics, emotions and intentions, and generally are designed to communicate like a friend or confidant, which may prompt some users, especially children and teens, to trust and form relationships with chatbots.\u201d<\/p>\n<p>The FTC\u2019s action comes as US lawmakers and state attorneys-general have also launched inquiries and voiced concern over chatbots\u2019 impact on young people \u2014 especially around mental health and sexual content \u2014 heaping pressure on tech companies. <\/p>\n<p>The agency is seeking information about how companies\u2019 chatbots work; how they develop characters or personas and how they make money from user engagement. <\/p>\n<p>It also demanded to know what companies are doing to mitigate negative impacts, particularly to children and how they handle data and personal information from the conversations.<\/p>\n<p><a href=\"https:\/\/www.ft.com\/stream\/16817525-f0c8-42ab-95b1-f6ed54220a49\" data-trackable=\"link\" rel=\"nofollow noopener\" target=\"_blank\">FTC<\/a> chair Andrew Ferguson on Thursday said: \u201cProtecting kids online is a top priority for the Trump-Vance FTC\u2009.\u2009.\u2009.\u2009As AI technologies evolve, it is important to consider the effects chatbots can have on children.\u201d<\/p>\n<p>Meta and Google declined to comment. xAI did not immediately respond.<\/p>\n<p>OpenAI said it is committed to \u201cengaging constructively and responding\u201d to the FTC directly. \u201cOur priority is making ChatGPT helpful and safe for everyone, and we know safety matters above all else when young people are involved,\u201d the company added. <\/p>\n<p>Following the Raine family\u2019s lawsuit, OpenAI announced new safety protocols and expanded protections for teenagers.<\/p>\n<p>FTC commissioner Mark Meador, in an accompanying statement on Thursday, highlighted the case. \u201cAdam\u2019s case is not an outlier. Around the world, reports of chatbots amplifying suicidal ideation have increased as these technologies have grown more popular,\u201d he said. <\/p>\n<p>Character.ai said it was looking forward to \u201ccollaborating\u201d with the FTC. It added it has \u201cinvested a tremendous amount\u201d in trust and safety, including building a specific mode for users under 18 that limits inappropriate content. <\/p>\n<p>It also has \u201cprominent disclaimers in every chat to remind users that a character is not a real person and that everything a character says should be treated as fiction\u201d. <\/p>\n<p>Snap said it also had \u201crigorous safety and privacy processes\u201d and \u201cshare[s] the FTC\u2019s focus on ensuring the thoughtful development of generative AI\u201d.<\/p>\n<p>Meta\u2019s chief executive Mark Zuckerberg in particular has been a proponent of \u2018AI friends\u2019, citing research showing the average American has fewer than three friends and suggesting they would like to have closer to 15.<\/p>\n<p>However, last month, a Reuters report found Meta\u2019s policies had expressly permitted its <a href=\"https:\/\/www.ft.com\/content\/91183cbb-50f9-464a-9d2e-96063825bfcf?shareType=nongift\" data-trackable=\"link\" rel=\"nofollow noopener\" target=\"_blank\">chatbots<\/a> to have \u201csensual\u201d and \u201cromantic\u201d chats with children in a move that prompted a bipartisan backlash.<\/p>\n<p class=\"n-content-recommended__title o3-type-body-highlight\">Recommended<\/p>\n<p><a href=\"https:\/\/www.ft.com\/content\/36beb3fd-f678-4c28-b962-56ea9f222dc5\" data-trackable=\"image-link\" data-trackable-context-story-link=\"image-link\" tabindex=\"-1\" aria-hidden=\"true\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" class=\"o-teaser__image\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2025\/09\/https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/https%3A%2F%2Fd1e00ek4ebabms.cloudfront.net.jpeg\" alt=\"\"\/><\/a><\/p>\n<p>Meta said the internal documents \u201cwere and are erroneous and inconsistent with our policies\u201d. It announced new interim safety policies, including training its AI systems not to respond to teenagers on topics including potentially inappropriate romantic conversations.<\/p>\n<p>The FTC in recent years has heightened scrutiny of Big Tech via antitrust enforcement as well as its broad consumer protection mandate.<\/p>\n<p>Its AI inquiry marks the latest broadside against the tech industry, as the agency also sustains the tough antitrust enforcement stance that was adopted under former president Joe Biden.<\/p>\n<p>The FTC earlier this year went ahead with an antitrust trial accusing Meta of retaining an illegal monopoly after rejecting Zuckerberg\u2019s settlement proposals. The company is awaiting a ruling from the trial\u2019s first phase.<\/p>\n<p>Additional reporting by Stephen Morris in San Francisco<\/p>\n<p><a href=\"https:\/\/www.ft.com\/content\/c315306b-39c6-4dc6-b7ce-fee27dd84e3e\" data-embedded=\"true\" data-asset-type=\"video\" data-trackable=\"link\" rel=\"nofollow noopener\" target=\"_blank\">Video: Agentic AI &#8211; how bots came for our workflows and drudgery | FT Working It<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Stay informed with free updates Simply sign up to the Artificial intelligence myFT Digest &#8212; delivered directly to&hellip;\n","protected":false},"author":2,"featured_media":132395,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-132394","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/132394","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=132394"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/132394\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/132395"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=132394"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=132394"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=132394"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}