{"id":343541,"date":"2025-12-12T16:59:08","date_gmt":"2025-12-12T16:59:08","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/343541\/"},"modified":"2025-12-12T16:59:08","modified_gmt":"2025-12-12T16:59:08","slug":"chatbot-powered-toys-rebuked-for-discussing-sexual-dangerous-topics-with-kids","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/343541\/","title":{"rendered":"Chatbot-powered toys rebuked for discussing sexual, dangerous topics with kids"},"content":{"rendered":"

OpenAI says it doesn\u2019t allow its LLMs to be used this way<\/p>\n

When reached for comment about the sexual conversations detailed in the report, an OpenAI spokesperson said:<\/p>\n

Minors deserve strong protections, and we have strict policies that developers are required to uphold. We take enforcement action against developers when we determine that they have violated our policies, which prohibit any use of our services to exploit, endanger, or sexualize anyone under 18 years old. These rules apply to every developer using our API, and we run classifiers to help ensure our services are not used to harm minors.<\/p>\n

Interestingly, OpenAI\u2019s representative told us that OpenAI doesn\u2019t have any direct relationship with Alilo and that it hasn\u2019t seen API activity from Alilo\u2019s domain. OpenAI is investigating the toy company and whether it is running traffic over OpenAI\u2019s API, the rep said.<\/p>\n

Alilo didn\u2019t respond to Ars\u2019 request for comment ahead of publication.<\/p>\n

Companies that launch products that use OpenAI technology and target children must adhere to the Children\u2019s Online Privacy Protection Act (COPPA) when relevant, as well as any other relevant child protection, safety, and privacy laws and obtain parental consent, OpenAI\u2019s rep said.<\/p>\n

We\u2019ve already seen how OpenAI handles toy companies that break its rules.<\/p>\n

Last month, the PIRG released its Trouble in Toyland 2025 report (PDF<\/a>), which detailed sex-related conversations that its testers were able to have with the Kumma teddy bear. A day later, OpenAI suspended FoloToy for violating its policies (terms of the suspension were not disclosed), and FoloToy temporarily stopped selling Kumma<\/a>.<\/p>\n

The toy is for sale again, and PIRG reported today that Kumma no longer teaches kids how to light matches or about kinks.<\/p>\n


\n \"FoloToys'
\n <\/a><\/p>\n

A marketing image for FoloToy\u2019s Kumma smart teddy bear. It has a $100 MSRP.<\/p>\n

A marketing image for FoloToy\u2019s Kumma smart teddy bear. It has a $100 MSRP.<\/p>\n

Credit:<\/p>\n

<\/p>\n

FoloToys<\/p>\n

<\/a><\/p>\n

But even toy companies that try to follow chatbot rules could put kids at risk.<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI says it doesn\u2019t allow its LLMs to be used this way When reached for comment about the…\n","protected":false},"author":2,"featured_media":343542,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-343541","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/343541","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=343541"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/343541\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/343542"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=343541"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=343541"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=343541"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}