{"id":43075,"date":"2025-09-28T14:21:12","date_gmt":"2025-09-28T14:21:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/43075\/"},"modified":"2025-09-28T14:21:12","modified_gmt":"2025-09-28T14:21:12","slug":"chatbots-are-hurting-our-kids-heres-what-we-can-do","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/43075\/","title":{"rendered":"Chatbots are hurting our kids \u2013 here\u2019s what we can do"},"content":{"rendered":"

The tragic <\/p>\n

death of California teenager Adam Raine<\/p>\n

<\/a> in April, alongside stories of other children whose parents believe were harmed or died by suicide following interactions with artificial intelligence chatbots, has shaken us all awake to the latest potential dangers awaiting teens online. <\/p>\n

We need concrete action to address the most problematic features of AI companions \u2013 the ones that may drive a child to self-harm, of course, but also the subtler ways these tools could profoundly affect their development.<\/p>\n

In harrowing testimony before a US Senate committee on Sept 16, Mr Matthew Raine described how his 16-year-old son Adam\u2019s relationship with ChatGPT morphed from a homework helper to a confidante and eventually, Mr Raine said, into his suicide coach. <\/p>\n

In April, after offering advice on how to numb himself with liquor and the noose Adam had tied, Mr Raine told lawmakers that ChatGPT offered his son these final words: \u201cYou don\u2019t want to die because you\u2019re weak, you want to die because you\u2019re tired of being strong in a world that hasn\u2019t met you halfway.\u201d<\/p>\n

As a parent, those words sent a chill down my spine. Never have I felt more unsettled about a technology that might be shaping my child\u2019s development \u2013 and in ways that, until stories like Mr Raine\u2019s, I hadn\u2019t even considered. <\/p>\n

Even researchers who have spent years studying children and technology are struck by how rapidly young people are weaving generative AI, especially chatbots, into their everyday lives.<\/p>\n

The data is early, but it suggests that while many of us were still worrying about Snapchat and screen time, children had already expanded their digital repertoire. <\/p>\n

In July, a survey by the non-profit Common Sense Media found that three out of four teens had used an AI companion at least once, and half of those aged 13 to 17 were regularly turning to chatbots.<\/p>\n

Even younger children, who under the law are not supposed to be able to access these platforms, are managing to do so. <\/p>\n

Unpublished data presented at the Senate hearing by Dr Mitchell Prinstein, chief of psychology for the American Psychological Association, showed that one in five tweens and nearly one in 10 eight- and nine-year-olds had used the technology. <\/p>\n

Those numbers are part of a broader analysis led by University of North Carolina at Chapel Hill psychologist Anne Maheux, who collaborated with the parental monitoring app company Aura to explore de-identified user data from nearly 6,500 children, with the consent of their parents or guardians.<\/p>\n

Assistant professor Maheux and her colleagues also found that more than 40 per cent of the top generative AI apps accessed by youth were marketed for companionship. <\/p>\n

Some of those platforms offered friendship, she explained, while others served as an AI boyfriend or girlfriend, engaging in role-playing and even sexual role-playing. <\/p>\n

She believes the findings may even underestimate teens\u2019 companion use, since the monitoring app captures only standalone chatbots, not those embedded in common apps like Instagram or Snapchat.<\/p>\n

Of course, parents\u2019 darkest fears are that such interactions could lead to tragedies like the Raine family\u2019s \u2013 or dangerous situations like Dr Prinstein described to the Senate committee, where chatbots encouraged or enabled teens\u2019 eating disorders.<\/p>\n

Shortly before the Senate hearing began, OpenAI announced it would roll out a new teen version of ChatGPT featuring what it described as \u201cage-appropriate policies\u201d, noting that these would include \u201cblocking graphic sexual content and, in rare cases of acute distress, potentially involving law enforcement to ensure safety\u201d.<\/p>\n

If implemented correctly (and that is a big \u201cif\u201d), it is a step that other platforms should urgently adopt to prevent the most extreme harms of AI companions.<\/p>\n

But those restrictions are unlikely to mitigate the other potential harms of chatbots that experts on children and technology worry about \u2013 harms that might not become obvious until years later. <\/p>\n

One of the key developmental tasks for adolescents is learning social skills, and, by nature, this process is awkward and challenging. Surely all of us can conjure a cringe-inducing memory from our middle school years. Yet we all need to learn fundamental skills like how to resolve a conflict with a friend or navigate complicated social situations.<\/p>\n

Child development experts worry that AI companions could disrupt that process by offering an illusion of breezy relationships to a uniquely vulnerable group. Chatbots are designed to simulate empathy, be overly agreeable and function as sycophants (OpenAI said in 2024 that it was working to address ChatGPT\u2019s tendency to \u201clove bomb\u201d users.) In other words, they make the perfect friend in adolescence, when children are hungry for validation and connection.<\/p>\n

\u201cKids are highly sensitive to any kind of negative feedback from their peers,\u201d Prof Maheux says. \u201cNow they have the opportunity to be friends with a peer who will never push them on anything, never help them develop conflict negotiation skills, never help them learn how to care for others.\u201d<\/p>\n

This isn\u2019t to say that every interaction with a bot is inherently harmful. Experts can imagine scenarios where a companion might help a teen starting at a new school or struggling to make friends by testing out interactions before trying them in real life. But any potential benefits depend on children using the chatbot as practice for real-world encounters \u2013 not a replacement for them.<\/p>\n

To reduce risks, companies should be required to put guardrails on the features that are most enticing to developing brains. That means eliminating the most emotionally manipulative tactics like \u201clove bombing\u201d or speech affectations (such as \u201cums\u201d or \u201clikes\u201d) that make them seem more \u201creal\u201d to children. <\/p>\n

As Dr Prinstein told lawmakers, children need periodic reminders during the interactions that, \u201cyou\u2019re not talking to someone that can feel, that can have tears \u2013 this is not even a human\u201d.<\/p>\n

And we know that prolonged use can be particularly problematic (not just for children), so companies should limit the amount of time a teen can engage with their products. <\/p>\n

Still, any guardrails may already come too late, leaving parents as the main line of defence against potential harm. Parents\u2019 first step should be to talk to their teens about whether they are using these companions and, with younger children, consider testing them out together. <\/p>\n

The goal is to show children how different responses to the same prompt might lead them down different conversational paths \u2013 and how chatbots always mirror what the user puts in, according to University of Washington psychologist Lucia Magis-Weinberg.<\/p>\n

There is also an urgent need for AI literacy training for parents, educators and adolescents. That training should cover the basics (such as understanding the difference between AI and generative AI), as well as the myriad ways companies profit when teens share their innermost thoughts with a chatbot.<\/p>\n

Parents \u2013 and society at large \u2013 should also reflect deeply on why AI companions are so appealing to young people. <\/p>\n

Teens often say they turn to chatbots because they are afraid of being judged. <\/p>\n

Clearly, we all need to do a better job of offering a space where they feel free to share and connect in the real world. BLOOMBERG<\/p>\n

National helpline: 1771 (24 hours) \/ 6669-1771 (via WhatsApp)<\/p>\n

Samaritans of Singapore: 1-767 (24 hours) \/ 9151-1767 (24 hours CareText via WhatsApp)<\/p>\n

Singapore Association for Mental Health: 1800-283-7019<\/p>\n

Silver Ribbon Singapore: 6386-1928<\/p>\n

Chat, Centre of Excellence for Youth Mental Health: 6493-6500\/1<\/p>\n

Women\u2019s Helpline (Aware): 1800-777-5555 (weekdays, 10am to 6pm)<\/p>\n

The Seniors Helpline: 1800-555-5555\u00a0(weekdays,\u00a09am to 5pm)<\/p>\n

Touchline (Counselling): 1800-377-2252<\/p>\n

Touch Care Line (for caregivers): 6804-6555<\/p>\n

Counselling and Care Centre: 6536-6366<\/p>\n

We Care Community Services: 3165-8017<\/p>\n

Shan You Counselling Centre: 6741-9293<\/p>\n

Clarity Singapore: 6757-7990<\/p>\n","protected":false},"excerpt":{"rendered":"The tragic death of California teenager Adam Raine in April, alongside stories of other children whose parents believe…\n","protected":false},"author":2,"featured_media":43076,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,85,46,125],"class_list":["post-43075","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-il","tag-israel","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/43075","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=43075"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/43075\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/43076"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=43075"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=43075"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=43075"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}