{"id":185317,"date":"2025-10-02T15:21:06","date_gmt":"2025-10-02T15:21:06","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/185317\/"},"modified":"2025-10-02T15:21:06","modified_gmt":"2025-10-02T15:21:06","slug":"my-son-genuinely-believed-it-was-real-parents-are-letting-little-kids-play-with-ai-are-they-wrong-artificial-intelligence-ai","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/185317\/","title":{"rendered":"\u2018My son genuinely believed it was real\u2019: Parents are letting little kids play with AI. Are they wrong? | Artificial intelligence (AI)"},"content":{"rendered":"

Josh was at the end of his rope when he turned to ChatGPT<\/a> for help with a parenting quandary. The 40-year-old father of two had been listening to his \u201csuper loquacious\u201d four-year-old talk about Thomas the Tank Engine for 45 minutes, and he was feeling overwhelmed.<\/p>\n

\u201cHe was not done telling the story that he wanted to tell, and I needed to do my chores, so I let him have the phone,\u201d recalled Josh, who lives in north-west Ohio. \u201cI thought he would finish the story and the phone would turn off.\u201d<\/p>\n

But when Josh returned to the living room two hours later, he found his child still happily chatting away with ChatGPT in voice mode. \u201cThe transcript is over 10k words long,\u201d he confessed in a sheepish Reddit post<\/a>. \u201cMy son thinks ChatGPT is the coolest train loving person in the world. The bar is set so high now I am never going to be able to compete with that.\u201d<\/p>\n

From radio and television to video games and tablets, new technology has long tantalized overstretched parents of preschool-age kids with the promise of entertainment and enrichment that does not require their direct oversight, even as it carried the hint of menace that accompanies any outside influence on the domestic sphere. A century ago, mothers in Arizona<\/a> worried that radio programs were \u201coverstimulating, frightening and emotionally overwhelming\u201d for children; today\u2019s parents self-flagellate over screen time<\/a> and social media<\/a>.<\/p>\n

But the startlingly lifelike capabilities of generative AI systems have left many parents wondering if AI is an entirely new beast<\/a>. Chatbots powered by large language models (LLMs) are engaging young children in ways the makers of board games, Teddy Ruxpin, Furby and even the iPad never dreamed of: they produce personalized bedtime stories, carry on conversations tailored to a child\u2019s interests, and generate photorealistic images of the most far-fetched flights of fancy \u2013 all for a child who can not yet read, write or type.<\/p>\n

Can generative AI deliver the holy grail of technological assistance to parents, serving as a digital Mary Poppins that educates, challenges and inspires, all within a framework of strong moral principles and age-appropriate safety? Or is this all just another Silicon Valley hype-bubble with a particularly vulnerable group of beta testers?<\/p>\n

\u2018My kids are the guinea pigs\u2019<\/p>\n

For Saral Kaushik, a 36-year-old software engineer and father of two in Yorkshire, a packet of freeze-dried \u201castronaut\u201d ice-cream in the cupboard provided the inspiration for a novel use of ChatGPT with his four-year-old son.<\/p>\n

\u201cI literally just said something like, \u2018I\u2019m going to do a voice call with my son and I want you to pretend that you\u2019re an astronaut on the ISS,\u2019\u201d Kaushik said. He also instructed the program to tell the boy that it had sent him a special treat.<\/p>\n

\u201c[ChatGPT] told him that he had sent his dad some ice-cream to try from space, and I pulled it out,\u201d Kaushik recalled. \u201cHe was really excited to talk to the astronaut. He was asking questions about how they sleep. He was beaming, he was so happy.\u201d<\/p>\n

Childhood is a time of magic and wonder, and dwelling in the world of make-believe is not just normal but encouraged by experts in early childhood development, who have long emphasized the importance of imaginative play. For some parents, generative AI can help promote that sense of creativity and wonder.<\/p>\n

Ying Xu: \u2018If [children] believe that AI has agency, they might understand it as the AI wanting to talk to them or choosing to talk to them.\u2019 Photograph: RooM the Agency\/Alamy<\/p>\n

Josh\u2019s daughter, who is six, likes to sit with him at the computer and come up with stories for ChatGPT to illustrate. (Several parents interviewed for this article requested to be identified by their first names only.) \u201cWhen we started using it, it was willing to make an illustration of my daughter and insert that in the story,\u201d Josh said, though more recent safety updates have resulted in it no longer producing images of children. Kaushik also uses ChatGPT to convert family photographs into coloring book pages for his son.<\/p>\n

Ben Kreiter, a father of three in Michigan, explained ChatGPT to his two-, six-, and eight-year-old children after they saw him testing its image-generation capabilities for work (he designs curriculums for an online parochial school). \u201cI was like, \u2018I tell the computer a picture to make and it makes it,\u2019 and they said: \u2018Can we try?\u2019\u201d Soon, the children were asking to make pictures with ChatGPT every day. \u201cIt was cool for me to see what they are imagining that they can\u2019t quite [draw] on a piece of paper with their crayons yet.\u201d<\/p>\n

Kreiter, like all the parents interviewed for this article, only allowed his children to use ChatGPT with his help and supervision, but as they became more enamored with the tool, his concern grew. In October 2024, news broke of a 14-year-old boy who killed himself<\/a> after becoming obsessed with an LLM-powered chatbot made by Character.ai. Parents of at least two more teenagers<\/a> have since filed lawsuits<\/a> alleging that AI chatbots contributed to their suicides, and news reports increasingly highlight troubling tales of adults forming intense emotional attachments<\/a> to the bots or otherwise losing touch with reality<\/a>.<\/p>\n

\u201cThe more that it became part of everyday life and the more I was reading about it, the more I realized there\u2019s a lot I don\u2019t know about what this is doing to their brains,\u201d Kreiter said. \u201cMaybe I should not have my own kids be the guinea pigs.\u201d<\/p>\n

[My daughter] knows [ChatGPT is] not a real person, but … it\u2019s like a fairy that represents the internet as a wholeJosh<\/p>\n

Research into how generative AI affects child development is in its early stages, though it builds upon studies looking at less sophisticated forms of AI, such as digital voice assistants like Alexa and Siri. Multiple studies<\/a> have found that young children\u2019s social interactions with AI tools differ subtly from those with humans, with children aged three to six appearing \u201cless active\u201d in conversations with smart speakers. This finding suggests that children perceive AI agents as existing somewhere in the middle of the divide between animate and inanimate entities, according to Ying Xu, a professor of education at the Harvard Graduate School of Education.<\/p>\n

Understanding whether an object is a living being or an artefact is an important cognitive development that helps a child gauge how much trust to place in the object, and what kind of relationship to form with it, explained Xu, whose research focuses on how AI can promote learning for children. Children<\/a> begin to make this distinction in infancy and usually develop a sophisticated understanding of it by age nine or 10. But while children have always imbued inanimate objects such as teddy bears and dolls with imagined personalities and capacities, at some level they know that the magic is coming from their own minds.<\/p>\n

\u201cA very important indicator of a child anthropomorphizing AI is that they believe AI is having agency,\u201d Xu said. \u201cIf they believe that AI has agency, they might understand it as the AI wanting to talk to them or choosing to talk to them. They feel that the AI is responding to their messages, and especially emotional disclosures, in ways that are similar to how a human responds. That creates a risk that they actually believe they are building some sort of authentic relationship.\u201d<\/p>\n

In one study<\/a> looking at children aged three to six responding to a Google Home Mini device, Xu found that the majority perceived the device to be inanimate, but some referred to it as a living being, and some placed it somewhere in between. Majorities thought the device possessed cognitive, psychological and speech-related capabilities (thinking, feeling, speaking and listening), but most believed it could not \u201csee\u201d.<\/p>\n

Parents who spoke with the Guardian remarked upon this kind of ontological gray zone in describing their children\u2019s interactions with generative AI. \u201cI don\u2019t fully know what he thinks ChatGPT is, and it\u2019s hard to ask him,\u201d said Kaushik of his four-year-old. \u201cI don\u2019t think he can articulate what he thinks it is.\u201d<\/p>\n

Josh\u2019s daughter refers to ChatGPT as \u201cthe internet\u201d, as in, \u201cI want to talk to \u2018the internet\u2019.\u201d \u201cShe knows it\u2019s not a real person, but I think it\u2019s a little fuzzy,\u201d he said. \u201cIt\u2019s like a fairy that represents the internet as a whole.\u201d<\/p>\n

For Kreiter, seeing his children interact with Amazon\u2019s Alexa at a friend\u2019s house raised another red flag. \u201cThey don\u2019t get that this thing doesn\u2019t understand them,\u201d he said. \u201cAlexa is pretty primitive compared to ChatGPT, and if they\u2019re struggling with that \u2026 I don\u2019t even want to go there with my kids.\u201d<\/p>\n

A related concern is whether generative AI\u2019s capacity to deceive children is problematic. For Kaushik, his son\u2019s sheer joy at having spoken with what he thought was a real-life astronaut on the ISS led to a sense of unease, and he decided to explain that it was \u201ca computer, not a person\u201d.<\/p>\n

\u201cHe was so excited that I felt a bit bad,\u201d Kaushik said. \u201cHe genuinely believed it was real.\u201d<\/p>\n

John, a 40-year-old father of two from Boston, experienced a similar qualm when his son, a four-year-old in the thralls of a truck obsession, asked whether the existence of monster trucks and fire trucks implied the existence of a monster-fire truck. Without thinking much of it, John pulled up Google\u2019s generative AI tool on his phone and used it to generate a photorealistic image of a truck that had elements of the two vehicles.<\/p>\n

When [LLMs are] latching on to negative emotion, they\u2019re extending engagement for profit-based reasonsAndrew McStay<\/p>\n

It was only after a pitched argument between the boy, who swore he had seen actual proof of the existence of a monster-fire truck, and his older sister, a streetwise seven-year-old who was certain that no such thing existed in the real world, that John started to wonder whether introducing generative AI into his children\u2019s lives had been the right call.<\/p>\n

\u201cIt was a little bit of a warning to maybe be more intentional about that kind of thing,\u201d he said. \u201cMy wife and I have talked so much more about how we\u2019re going to handle social media than we have about AI. We\u2019re such millennials, so we\u2019ve had 20 years of horror stories about social media, but so much less about AI.\u201d<\/p>\n

To Andrew McStay, a professor of technology and society at Bangor University who specializes in research on AI that claims to detect human emotions, this kind of reality-bending is not necessarily a big concern. Recalling the early moving pictures of the Lumi\u00e8re brothers, he said: \u201cWhen they first showed people a big screen with trains coming [toward them], people thought the trains were quite literally coming out of the screen. There\u2019s a maturing to be done \u2026 People, children and adults, will mature.\u201d<\/p>\n

Still, McStay sees a bigger problem with exposing children to technology powered by LLMs: \u201cParents need to be aware that these things are not designed in children\u2019s best interests.\u201d<\/p>\n

Like Xu, McStay is particularly concerned with the way in which LLMs can create the illusion of care or empathy, prompting a child to share emotions \u2013 especially negative emotions. \u201cAn LLM cannot [empathize] because it\u2019s a predictive piece of software,\u201d he said. \u201cWhen they\u2019re latching on to negative emotion, they\u2019re extending engagement for profit-based reasons. There is no good outcome for a child there.\u201d<\/p>\n

Neither Xu nor McStay wants to ban generative AI for children, but they do warn that any benefits for children will only be unleashed through applications that are specifically designed to support children\u2019s development or education.<\/p>\n

\u201cThere is something more enriching that\u2019s possible, but that comes from designing these things in a well-meaning and sincere way,\u201d said McStay.<\/p>\n

For an individual child, [AI] might increase their performance, but for a society, we might see a decrease of diversity in creative expressionsYing Xu<\/p>\n

Xu allows her own children to use generative AI \u2013 to a limited extent. Her daughter, who is six, uses the AI reading program<\/a> that Xu designed to study whether AI can promote literacy and learning. She has also set up a custom version of ChatGPT to help her 10-year-old son with math and programming problems without just giving him the answers. (Xu has explicitly disallowed conversations about gaming and checks the transcripts to make sure her son\u2019s staying on topic.)<\/p>\n

One of the benefits of generative AI mentioned to me by parents \u2013 the creativity they believe it fosters \u2013 is very much an open question, said Xu.<\/p>\n

\u201cThere is still a debate over whether AI itself has creativity,\u201d she said. \u201cIt\u2019s just based on statistical predictions of what comes next, and a lot of people question if that counts as creativity. So if AI does not have creativity, is it able to support children to engage in creative play?\u201d<\/p>\n

A recent study<\/a> found that having access to generative AI prompts did increase creativity for individual adults tasked with writing a short story, but decreased the overall diversity of the writers\u2019 collective output.<\/p>\n

\u201cI\u2019m a little worried by this kind of homogenizing of expression and creativity,\u201d Xu said about the study. \u201cFor an individual child, it might increase their performance, but for a society, we might see a decrease of diversity in creative expressions.\u201d<\/p>\n

AI \u2018playmates\u2019 for kids<\/p>\n

Silicon Valley is notorious for its willingness to prioritize speed over safety, but major companies have at times shown a modicum of restraint when it came to young children. Both YouTube and Facebook had existed for at least a decade before they launched dedicated products for under-13s (the much-maligned YouTube Kids<\/a> and Messenger Kids<\/a>, respectively).<\/p>\n

But the introduction of LLMs to young children appears to be barreling ahead at a breakneck pace.<\/p>\n

While OpenAI bars users under 13<\/a> from accessing ChatGPT, and requires parental permission for teenagers, it is clearly aware that younger children are being exposed to it \u2013 and views them as a potential market.<\/p>\n

In June, OpenAI announced a \u201cstrategic collaboration<\/a>\u201d with Mattel, the toymaker behind Barbie, Hot Wheels and Fisher-Price. That same month, chief executive Sam Altman responded to the tale of Josh\u2019s toddler (which went pretty viral on Reddit) with what sounded like a hint of pride. \u201cKids love voice mode on ChatGPT,\u201d he said on the OpenAI podcast<\/a>, before acknowledging that \u201cthere will be problems\u201d and \u201csociety will have to figure out new guardrails.\u201d<\/p>\n

Meanwhile, startups such as Silicon Valley-based Curio \u2013 which collaborated with the musician Grimes on an OpenAI-powered toy named Grok<\/a> \u2013 are racing to stuff LLM-equipped voice boxes into plushy toys and market them to children.<\/p>\n

A child swings on a swing with Grem, a chatbot in the Grok toy line by Curio. Photograph: Hannah Yoon\/The Guardian<\/p>\n

(Curio\u2019s Grok shares a name with Elon Musk\u2019s LLM-powered chatbot, which is notorious<\/a> for its past promotion of Adolf Hitler and racist conspiracy theories. Grimes, who has three children with former partner Musk, was reportedly<\/a> angered when Musk used a name she had chosen for their second child on another child, born to a different mother in a concurrent pregnancy of which Grimes was unaware. In recent months, Musk has expressed interest in creating a \u201cBaby Grok\u201d version of his software for children aged two to 12, according to the New York Times<\/a>.)<\/p>\n

The pitch for toys like Curio\u2019s Grok is that they can \u201clearn\u201d your child\u2019s personality and serve as a kind of fun and educational companion while reducing screen time. It is a classically Silicon Valley niche \u2013 exploiting legitimate concerns about the last generation of tech to sell the next. Company leaders have also referred<\/a> to the plushy as something \u201cbetween a little brother and a pet\u201d or \u201clike a playmate\u201d \u2013 language that implies the kind of animate agency that LLMs do not actually have.<\/p>\n

It is not clear if they are actually good enough toys for parents to worry too much about. Xu said that her daughter had quickly relegated AI plushy toys to the closet, finding the play possibilities \u201ckind of repetitive\u201d. The children of Guardian<\/a> and New York Times<\/a> writers also voted against Curio\u2019s toys with their feet. Guardian writer Arwa Mahdawi expressed concern about how \u201cunsettlingly obsequious\u201d the toy was and decided she preferred allowing her daughter to watch Peppa Pig: \u201cThe little oink may be annoying, but at least she\u2019s not harvesting our data.\u201d Times writer Amanda Hess similarly concluded that using an AI toy to replace TV time \u2013 a necessity for many busy parents \u2013 is \u201ca bit like unleashing a mongoose into the playroom to kill all the snakes you put in there\u201d.<\/p>\n

But with the market for so-called smart toys \u2013 which includes AI-powered toys, projected to double<\/a> to more than $25bn by 2030 \u2013 it is perhaps unrealistic to expect restraint.<\/p>\n

This summer, notices seeking children aged four to eight to help \u201ca team from MIT and Harvard\u201d test \u201cthe first AI-powered storytelling toy\u201d appeared in my neighborhood in Brooklyn. Intrigued, I made an appointment to stop by their offices.<\/p>\n

The product, Geni<\/a>, is a close cousin to popular screen-free audio players<\/a> such as Yoto and the Toniebox. Rather than playing pre-recorded content (Yoto and Tonies offer catalogs of audiobooks, podcasts and other kid-friendly content for purchase), however, Geni uses an LLM to generate bespoke short stories. The device allows child users to select up to three \u201ctiles\u201d representing a character, object or emotion, then press a button to generate a chunk of narrative that ties the tiles together, which is voiced aloud. Parents can also use an app to program blank tiles.<\/p>\n

Geni co-founders Shannon Li and Kevin Tang struck me as being serious and thoughtful about some of the risks of AI products for young children. They \u201cfeel strongly about not anthropomorphizing AI\u201d, Tang said. Li said that they want kids to view Geni, \u201cnot as a companion\u201d like the voice-box plushies, but as \u201ca tool for creativity that they already have\u201d.<\/p>\n

Still, it\u2019s hard not to wonder whether an LLM can actually produce particularly engaging or creativity-sparking stories. Geni is planning to sell sets of tiles with characters they develop in-house alongside the device, but the actual \u201cstorytelling\u201d is done by the kind of probability-based technology that tends toward the average.<\/p>\n

The story I prompted by selecting the wizard and astronaut tiles was insipid at best:<\/p>\n

They stumbled upon a hidden cave glowing with golden light.<\/p>\n

\u201cWhat\u2019s that?\u201d Felix asked, peeking inside.<\/p>\n

\u201cA treasure?\u201d Sammy wondered, her imagination swirling, \u201cor maybe something even cooler.\u201d<\/p>\n

Before they could decide, a wave rushed into the cave, sending bubbles bursting around them.<\/p>\n

The Geni team has trained their system on pre-existing children\u2019s content. Does using generative AI solve a problem for parents that the canon of children\u2019s audio content cannot? When I ran the concept by one parent of a five-year-old, he responded: \u201cThey\u2019re just presenting an alternative to books. It\u2019s a really good example of grasping for uses that are already handled by artists or living, breathing people.\u201d<\/p>\n

The market pressures of startup culture leave little time for such existential musings, however. Tang said the team is eager to bring their product to market before voice-box plushies sour parents on the entire concept of AI for kids.<\/p>\n

When I asked Tang whether Geni would allow parents to make tiles for, say, a gun \u2013 not a far-fetched idea for many American families \u2013 he said they would have to discuss the issue as a company.<\/p>\n

\u201cPost-launch, we\u2019ll probably bring on an AI ethics person to our team,\u201d he said.<\/p>\n

\u201cWe also don\u2019t want to limit knowledge,\u201d he added. \u201cAs of now there\u2019s no right or wrong answer to how much constraint we want to put in \u2026 But obviously we\u2019re referencing a lot of kids content that\u2019s already out there. Bluey probably doesn\u2019t have a gun in it, right?\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Josh was at the end of his rope when he turned to ChatGPT for help with a parenting…\n","protected":false},"author":2,"featured_media":185318,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-185317","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/185317","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=185317"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/185317\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/185318"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=185317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=185317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=185317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}