ChattyBear, a soft, brown-furred teddy bear, begins every conversation with a jubilant, \u201cHello, my buddy!\u201d<\/p>\n
No longer the province of the imagination, ChattyBear is part of a new generation of artificial intelligence (AI) toys. It can tell stories, chat about a child\u2019s interests, play games or even discuss what\u2019s happening in the world today. <\/p>\n
These high tech toys are powered by generative AI engines such as ChatGPT and are now widely available online. They are being marketed as a way to give children as young as three an educational advantage and a new type of play \u2013 without the perils of screen time<\/a>.<\/p>\n After evaluating six different AI teddy bears and toys over several months, it\u2019s clear how these toys could feel compelling for children. Yet as our new report<\/a> highlights, there are new risks that come with AI toys turning up in young children\u2019s lives.<\/p>\n Sounding human<\/p>\n For younger children especially, understanding that their teddy or toy isn\u2019t \u201calive\u201d or magic<\/a> can be hard. This is especially true if \u201cteddy\u201d uses language that positions it as a trusted friend \u2013 for example, by insisting it is a \u201creal buddy\u201d.<\/p>\n This is a feature of many AI toys. <\/p>\n Sounding human builds an artificial sense of trust and intimacy, which can be especially problematic for children when combined with sycophantic language choices<\/a> \u2013 or excessively agreeable, validating and even flattering language. <\/p>\n Research shows young children are particularly prone to developing a strong sense of emotional attachment<\/a> to conversational AI agents.<\/p>\n Increased trust leads to increased use and engagement with the toys. Recent estimates<\/a> suggest close to 80% of children aged 10 to 17 have used an AI companion or assistant, so it\u2019s urgent children and young people be taught how to \u201creality check\u201d their AI \u201cbuddies\u201d.<\/p>\n Infinite chat<\/p>\n The marketing materials for many AI toys often highlight<\/a> \u201cendless conversations\u201d as a feature of these devices.<\/p>\n But enabling endless conversations, or infinite chat, poses risks when it comes to children learning how to moderate their technology use. Research has also found some AI toys discuss very adult topics<\/a> \u2013 such as sexual fetishes<\/a> and how to find knives and start fires.<\/p>\n Infinite chat also opens the door to infinite data collection.<\/p>\n The potentially intimate nature of conversations with AI toys might lead children to presume their conversations are private. But most AI terms of use reveal the opposite to be true<\/a>.<\/p>\n Sharing personal details with a friendly bear might feel safe. But that chat could be training data<\/a> for the next large language model.<\/p>\n Marketing material for ChattyBear says<\/a> the toy offers \u201csafe, filtered content for children\u201d. The Conversation contacted the manufacturer for further detail about this but did not receive a response before deadline.<\/p>\n<\/p>\n Children\u2019s wellbeing<\/p>\n Childhood is a critical period when young people develop the social and emotional skills to form and maintain trusting relationships. These skills are usually learned through interactions with trusted friends and adults. <\/p>\n Children\u2019s rights advocates have raised concerns that excessive engagement with AI agents may reduce opportunities for children to develop these skills<\/a>.<\/p>\n And the risks may compound over time. <\/p>\n Initially, time spent with AI agents may displace time interacting with real humans. Fewer opportunities to build these skills could lead to a reduced capacity to maintain caring human relationships. Difficulties in maintaining human relationships may promote a preference of machine over human relationships as children expect \u201cfrictionless\u201d interactions.<\/p>\n Eventually, these developments may lead to less satisfying human connections, increasing loneliness, which in turn promotes increased time spent with AI.<\/p>\n The novelty of AI toys means there is little evidence to confirm these possible detrimental impacts. Further research is needed<\/a> \u2013 especially as the AI toy industry is set to grow even more. <\/p>\n
\nIn the social media realm, the infinite scroll of TikTok or Instagram is seen as a potential challenge<\/a> to teens limiting their use to healthy amounts.<\/p>\n