As the holiday season looms into view with Black Friday, one category on people\u2019s gift lists is causing increasing concern: products with artificial intelligence.<\/p>\n
The development has raised new concerns about the dangers smart toys could pose to children, as consumer advocacy groups say AI could harm kids\u2019 safety and development. The trend has prompted calls for increased testing of such products and governmental oversight.<\/p>\n
\u201cIf we look into how these toys are marketed and how they perform and the fact that there is little to no research that shows that they are beneficial for children \u2013 and no regulation of AI toys \u2013 it raises a really big red flag,\u201d said Rachel Franz, director of Young Children Thrive Offline, an initiative from Fairplay<\/a>, which works to protect children from big tech.<\/p>\n Last week, those fears were given brutal justification when an AI-equipped teddy bear started discussing sexually explicit topics.<\/p>\n The product, FoloToy\u2019s Kumma, ran on an OpenAI model and responded to questions about kink. It suggested bondage and roleplay as ways to enhance a relationship, according to a report from the Public Interest Research Group (Pirg), the consumer protection organization behind the study<\/a>.<\/p>\n \u201cIt took very little effort to get it to go into all kinds of sexually sensitive topics and probably a lot of content that parents would not want their children to be exposed to,\u201d said Teresa Murray, Pirg consumer watchdog director.<\/p>\n Products like the teddy bear are part of a global smart-toy market valued at $16.7bn in 2023, according to Allied Market Research<\/a>.<\/p>\n The industry is particularly big in China, which has more than 1,500 AI toy companies, which are working to expand abroad, MIT Technology Review<\/a> reports.<\/p>\n In addition to the Shanghai-based startup FoloToy, Curio, a California-based company, works with OpenAI and makes a stuffed toy, Grok<\/a>, as in Elon Musk\u2019s chatbot, voiced by the musician Grimes. In June, Mattel, which owns brands like Barbie and Hot Wheels, also announced<\/a> a partnership with OpenAI to \u201csupport AI-powered products and experiences\u201d.<\/p>\n Before the Pirg report on the creepy teddy bear, parents, technology researchers and lawmakers had already raised concerns about the impact of bots on minors\u2019 mental health. In October, the chatbot company Character.AI announced that it would ban users under 18 following a lawsuit<\/a> alleging that its bot exacerbated a teen\u2019s depression and caused him to kill himself.<\/p>\n Murray said AI toys could be particularly dangerous because whereas earlier smart toys provided children-programmed responses, a bot can \u201chave a free-flowing conversation with a child and there are no boundaries, as we found\u201d.<\/p>\n That could not only lead to sexually explicit conversations, but children could become attached to a bot rather than a person or imaginary friend, which could hurt their development, said Jacqueline Woolley, director of the Children\u2019s Research Center at the University of Texas at Austin.<\/p>\n For example, a child can benefit from having a disagreement with a friend and learning how to resolve it. That is less likely to happen with bots, which are often sycophantic<\/a>, said Woolley, who consulted on the Pirg study.<\/p>\n \u201cI worry about inappropriate bonding,\u201d Woolley said.<\/p>\n Companies also use the AI toys to collect data from children and have not been transparent about what they are doing with that information, Franz, of Fairplay, said. That potentially puts users at risk because of a lack of security around such data, Franz said. Hackers have<\/a> been able to take control of AI products.<\/p>\n \u201cBecause of the trust that the toys engender, I would say that children are more likely to tell their deepest thoughts to these toys,\u201d Franz said. \u201cThe surveillance is unnecessary and inappropriate.\u201d<\/p>\n Despite such concerns, Pirg is not calling for a ban on AI toys, which could have educational value, like helping children learn a second language or state capitals, Murray said.<\/p>\n \u201cThere is nothing wrong with having some kind of educational tool, but that same educational tool isn\u2019t telling you that it\u2019s your best friend, that you can tell me anything,\u201d Murray said.<\/p>\n The organization is calling for additional regulation of these toys for children under 13 but has not made specific policy recommendations, Murray said.<\/p>\n There also needs to be more independent research conducted to ensure the products are safe for children and, until that is done, they should be pulled from shelves, Franz said.<\/p>\n \u201cWe need short-term and longitudinal independent research on the impacts of children interacting with AI toys, including their social-emotional development\u201d and cognitive development, Franz said.<\/p>\n Following the Pirg report, OpenAI announced it was suspending FoloToy. That company\u2019s CEO then told CNN<\/a> that it was pulling the bear from the market and \u201cconducting an internal safety audit\u201d.<\/p>\n On Thursday, 80 organizations, including Fairplay, issued an advisory<\/a> urging families not to buy AI toys this holiday season.<\/p>\n \u201cAI toys are being marketed to families as safe and even beneficial to learning before their impact has been assessed by independent research,\u201d the release states. \u201cBy contrast, offline teddy bears and toys have been proven to benefit children\u2019s development with none of the risks of AI toys.\u201d<\/p>\n Curio, maker of the Grok toy, told the Guardian in an email that after reviewing the Pirg report, \u201cwe are actively working with our team to address any concerns, while continuously overseeing content and interactions to ensure a safe and enjoyable experience for children\u201d.<\/p>\n Mattel stated that its first products with OpenAI \u201cwill focus on families and older customers\u201d and that \u201cuse of OpenAI APIs is not intended for users under 13\u201d.<\/p>\n \u201cAI complements\u2013not replaces\u2013traditional play, and we are emphasizing safety, privacy, creativity and responsible innovation,\u201d the company stated.<\/p>\n Franz referred to past privacy concerns<\/a> with Mattel\u2019s smart products<\/a> and said: \u201cIt\u2019s good that Mattel is claiming that their AI products are not for young kids, but if we look at who plays with toys and who toys are marketed to, it\u2019s young children.\u201d<\/p>\n Franz added: \u201cWe\u2019re very interested in learning the concrete steps Mattel will take to ensure their OpenAI products are not actually used by kids who will surely recognize and be attracted to the brands.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"As the holiday season looms into view with Black Friday, one category on people\u2019s gift lists is causing…\n","protected":false},"author":2,"featured_media":164405,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,61,60,80],"class_list":{"0":"post-164404","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-ie","12":"tag-ireland","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/164404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=164404"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/164404\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/164405"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=164404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=164404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=164404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}