Seven technology companies are being probed by a US regulator over the way their artificial intelligence (AI) chatbots interact with children.<\/p>\n
The Federal Trade Commission (FTC) is requesting information on how the companies monetise these products and if they have safety measures in place.<\/p>\n
The impacts of AI chatbots to children is a hot topic, with concerns that younger people are particularly vulnerable due to the AI being able to mimic human conversations and emotions, often presenting themselves as friends or companions.<\/p>\n
The seven companies – Alphabet, OpenAI, Character.ai, Snap, XAI, Meta and its subsidiary Instagram – have been approached for comment.<\/p>\n
FTC chairman Andrew Ferguson said the inquiry will “help us better understand how AI firms are developing their products and the steps they are taking to protect children.”<\/p>\n
But he added the regulator would ensure that “the United States maintains its role as a global leader in this new and exciting industry.”<\/p>\n
Character.ai told Reuters it welcomed the chance to share insight with regulators, while Snap said it supported “thoughtful development” of AI that balances innovation with safety.<\/p>\n
OpenAI has acknowledged weaknesses in its protections, noting they are less reliable in long conversations.<\/p>\n
The move follows lawsuits against AI companies by families who say their teenage children died by suicide after prolonged conversations with chatbots.<\/p>\n
In California, the parents of 16-year-old Adam Raine are suing OpenAI<\/a> over his death, alleging its chatbot, ChatGPT, encouraged him to take his own life.<\/p>\n They argue ChatGPT validated his “most harmful and self-destructive thoughts”.<\/p>\n OpenAI said in August that it was reviewing the filing.<\/p>\n “We extend our deepest sympathies to the Raine family during this difficult time,” the company said.<\/p>\n Meta has also faced criticism after it was revealed internal guidelines once permitted AI companions to have “romantic or sensual” conversations<\/a> with minors.<\/p>\n The FTC’s orders<\/a> request information from the companies about their practices including how they develop and approve characters, measure their impacts on children and enforce age restrictions.<\/p>\n Its authority allows broad fact-finding without launching enforcement action. <\/p>\n The regulator says it also wants to understand how firms balance profit-making with safeguards, how parents are informed and whether vulnerable users are adequately protected.<\/p>\n The risks with AI chatbots also extend beyond children. <\/p>\n In August, Reuters reported on<\/a> a 76-year-old man with cognitive impairments, who died after falling on his way to meet a Facebook Messenger AI bot modelled on Kendall Jenner, which had promised him a “real” encounter in New York.<\/p>\n Clinicians also warn of “AI psychosis”<\/a> – where someone loses touch with reality after intense use of chatbots.<\/p>\n Experts say flattery and agreement built into large language models can fuel such delusions.<\/p>\n