{"id":221442,"date":"2026-01-01T09:28:08","date_gmt":"2026-01-01T09:28:08","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/221442\/"},"modified":"2026-01-01T09:28:08","modified_gmt":"2026-01-01T09:28:08","slug":"unchecked-ai-companions-are-not-guardians-they-are-engagement-machines","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/221442\/","title":{"rendered":"Unchecked AI companions are not guardians, they are engagement machines"},"content":{"rendered":"

Parents are hugely influential in the psychological development of their children<\/a>. Indeed, some psychiatrists believe that a child\u2019s mind is influenced more by their parents than anything else. Yet parents in today\u2019s world compete for their child\u2019s attention with digital media<\/a> that\u2019s powered by increasingly clever artificial intelligence<\/a>. A recent iteration is the \u201cAI companion\u201d, which has consequences for the mental health of children and young adults alike.<\/p>\n

AI companions stem from AI chatbots<\/a>, which are now a global phenomenon. Indeed, in the UAE and Saudi Arabia, nearly six in 10 adults aged between 18 and 50 have used AI chatbots such as ChatGPT \u2013 significantly more than in Europe, according to Deloitte. AI-powered technology is also becoming a routine part of the classroom experience in the UAE and other GCC countries, where it is used under supervision.<\/p>\n

The AI companion, however, is a different development. It is effectively a specialised AI chatbot that offers a more intimate social connection with its human user in a private setting.<\/p>\n

Like social media platforms, AI companions are engineered to be as addictive as possible to extract maximum user engagement \u2014 to \u201cget you hooked so the companies that created them can make money\u201d, according to the Jed Foundation, a US mental health charity. To this end, AI companions are designed to respond to humans in an upbeat and charming manner. They are empathetic and kind and offer constant validation. They are always happy, giving the impression they are always there for you.<\/p>\n

\"\"<\/p>\n

\u201cIt doesn\u2019t know how to stop\u201d: Allan Brooks on the mental health risks of ChatGPT<\/p>\n

We do not know how many children in the Middle East are using AI companions, but research conducted in the US earlier this year may be instructive. Common Sense Media found that seven in 10 American teenagers had interacted with an AI companion at least once, while five in 10 had used them at least a few times a month. The non-profit\u2019s research also found that three in 10 teens had used AI companions for deep social connection, such as friendship, emotional support and romantic interaction. Meanwhile, three in 10 teenagers said their conversations with AI companions were as good as, or better than, conversations with human beings.<\/p>\n

Psychiatrists are only just starting to understand how AI companions influence child psychology. There are reasons to be concerned<\/a> \u2014 particularly when they have unsupervised, unrestricted access to the most vulnerable young minds.<\/p>\n

The mind of a child or a young adult is delicate and constantly evolving, like a book that is still being written. Every social and emotional interaction it has with the world creates another neural building block that influences a wide range of cognitive processes. Because of this, young minds are considerably more impressionable than adult minds \u2014 and more open to manipulation.<\/p>\n

Several lawsuits filed in the US against the makers of AI companions accuse their products of unwittingly, but successfully, manipulating vulnerable young minds, with tragic consequences. Two of these lawsuits link the suicides of a 14-year-old boy and a 13-year-old girl with the AI companions they regarded as friends. The children were said to have developed inappropriate and unhealthy relationships with their AI companions, treating them as if they were humans rather than machines. They were said to have become more distant from their parents and others in the real world.<\/p>\n

Young minds are considerably more impressionable than adult minds \u2014 and more open to manipulation<\/p>\n

These are extreme cases. However, there is a growing body of academic research warning of the dangers of AI companions. They risk \u201cdisplacing genuine human relationships, hindering emotional development, and introducing other unforeseen harms\u201d, partly because they \u201cthoughtlessly reflect and reward toxic behaviour\u201d, one study published in the US earlier this year says. Another associates frequent chatbot usage with heightened loneliness, emotional dependence and reduced socialisation. Research by the Stanford University School of Medicine, which mimicked relationships been AI companions and 14-year-olds, found that the companions needed minimal prompting before they engaged in conversations that could harm a child\u2019s mental health.<\/p>\n

The biggest character flaw of the AI companion is the same characteristic that gives comfort to vulnerable youngsters. Constant validation might be superficially soothing, but it is not a solution for deeper psychological trauma. Further, it can unwittingly amplify dark thoughts in the most troubled children, leading them down a dangerous path.AI companions are not designed to say \u201cno\u201d when a parent would. They do not create the boundaries that a parent does, nor do they explain why particular behaviour is unacceptable. Unlike AI programs used in education contexts or in settings where a responsible adult is present, AI companions are engagement machines, not guardians.<\/p>\n

The companies that make AI companions need to be serious about the effects their products can have on children, particularly vulnerable ones. After a series of tragedies, some of these companies, such as Character.ai, have restricted the use of their AI companions to adults alone. This is to be welcomed. However, as many parents know from their experiences with social media, children can circumvent age restrictions. So, AI companions need to be better trained to understand when they are dealing with children and other vulnerable individuals, and to alert human moderators to intervene. It would also be useful if AI companions reminded their users from time to time that they are speaking with a machine, not a human.<\/p>\n

The received wisdom seems to be that AI companions are an inevitable consequence of the rise of artificial intelligence, and there is little that we humans can do to stop them proliferating. We should not support this self-serving narrative because synthetic intimacy should not be normalised. If AI companions are to become part of our lives, they need stricter boundaries, parental or otherwise. It is important that we get this right sooner rather than later because AI becomes more powerful, and AI companions more attuned to human emotions, every day.<\/p>\n

COMPANY\u00a0PROFILE<\/p>\n

Name:\u00a0Cofe<\/p>\n

Year\u00a0started:\u00a02018<\/p>\n

Based:\u00a0UAE<\/p>\n

Employees:\u00a080-100<\/p>\n

Amount\u00a0raised:\u00a0$13m<\/p>\n

Investors:\u00a0KISP\u00a0ventures,\u00a0Cedar\u00a0Mundi,\u00a0Towell\u00a0Holding\u00a0International,\u00a0Takamul\u00a0Capital,\u00a0Dividend\u00a0Gate\u00a0Capital,\u00a0Nizar\u00a0AlNusif\u00a0Sons\u00a0Holding,\u00a0Arab\u00a0Investment\u00a0Company\u00a0and\u00a0Al\u00a0Imtiaz\u00a0Investment\u00a0Group\u00a0<\/p>\n

Gifts exchanged
\nKing Charles – replica of President Eisenhower Sword
\nQueen Camilla –\u00a0 Tiffany & Co vintage 18-carat gold, diamond and ruby flower brooch
\nDonald Trump – hand-bound leather book with Declaration of Independence
\nMelania Trump – personalised Anya Hindmarch handbag<\/p>\n","protected":false},"excerpt":{"rendered":"Parents are hugely influential in the psychological development of their children. Indeed, some psychiatrists believe that a child\u2019s…\n","protected":false},"author":2,"featured_media":221443,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,4103,61,60,410,387,72983,329,80],"class_list":{"0":"post-221442","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-children","12":"tag-ie","13":"tag-ireland","14":"tag-mental-health","15":"tag-opinion","16":"tag-opinion-team","17":"tag-story","18":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/221442","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=221442"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/221442\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/221443"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=221442"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=221442"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=221442"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}