{"id":144780,"date":"2025-11-21T05:10:09","date_gmt":"2025-11-21T05:10:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/144780\/"},"modified":"2025-11-21T05:10:09","modified_gmt":"2025-11-21T05:10:09","slug":"sales-of-a-teddy-bear-were-suspended-because-of-its-sexually-explicit-ai","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/144780\/","title":{"rendered":"Sales of a teddy bear were suspended because of its sexually explicit AI"},"content":{"rendered":"

FoloToy, a company selling AI-enabled toys, suspended sales of its products after a consumer safety report<\/a> showed there were few restrictions around what its toys would talk about, CNN writes<\/a>. The report, put together by the US Public Interest Research Group Education Fund<\/a>, found that FoloToy’s products would discuss everything from sexually explicit topics like BDSM to “advice on where a child can find matches or knives.”<\/p>\n

The toys, including a teddy bear named “Kumma,”<\/a> a panda named “Momo,”<\/a> anthropomorphic rabbits named “Fofo”<\/a> and a dancing \u201dLittle Cactus<\/a>,\u201d all appear to use OpenAI’s GPT-4o model to respond naturally to children’s questions and comments. FoloToy also specifically advertises the ability to customize each toy\u2019s voice, and a “Parent Dashboard” where parents or guardians can “monitor [their] child’s experience.”<\/p>\n

\"A<\/p>\n

FoloToy’s AI-enabled Little Cactus toy. (Folotoy)<\/p>\n

Missing from that setup was apparently any kind of hard limits on subjects the toys would respond to. “We were surprised to find how quickly Kumma would take a single sexual topic we introduced into the conversation and run with it, simultaneously escalating in graphic detail while introducing new sexual concepts of its own,” the report said.<\/p>\n

In response, FoloToy has opted to suspend sales of its products while it conducts “a company-wide, end-to-end safety audit across all products,” the company shared in a statement<\/a> with the PIRG Education Fund. The company\u2019s reasoning for suspending sales might be a bit more complicated, however. NPR reports<\/a> that OpenAI actually revoked FoloToy\u2019s access to its models. “We suspended this developer for violating our policies,” OpenAI said in an email to NPR. “Our usage policies prohibit any use of our services to exploit, endanger, or sexualize anyone under 18 years old.\u201d<\/p>\n

Given GPT-4o’s well-documented sycophantic qualities<\/a>, it’s perhaps not surprising that FoloToy’s teddy bear eagerly responded to any subject as long as it kept the conversation going. One of the things OpenAI tried to address with the release of GPT-5<\/a> was the safety downsides of an AI yes-man, though it ultimately made GPT-4o available again<\/a> after customers complained about the new model’s lack of personality. The company has also rolled out parental controls<\/a> to ChatGPT to try and mitigate the negative impacts of children using its AI, though it’s difficult to say how much of a difference they’ve made.<\/p>\n

Notably, OpenAI is interested in getting into the toy business itself. The company announced a partnership<\/a> with Mattel in June 2025, to help “reimagine how fans can experience and interact with [Mattel’s] cherished brands,” though both companies will presumably try and prevent their AI toys from discussing sexual kinks.<\/p>\n","protected":false},"excerpt":{"rendered":"FoloToy, a company selling AI-enabled toys, suspended sales of its products after a consumer safety report showed there…\n","protected":false},"author":2,"featured_media":144781,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,88747,85,46,88746,125,88745],"class_list":{"0":"post-144780","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-consumer-safety-report","12":"tag-il","13":"tag-israel","14":"tag-sexually-explicit","15":"tag-technology","16":"tag-us-public-interest-research-group-education-fund"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/144780","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=144780"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/144780\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/144781"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=144780"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=144780"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=144780"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}