{"id":108689,"date":"2025-08-31T12:45:22","date_gmt":"2025-08-31T12:45:22","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/108689\/"},"modified":"2025-08-31T12:45:22","modified_gmt":"2025-08-31T12:45:22","slug":"the-rise-of-humanlike-chatbots-detracts-from-developing-ai-for-the-human-good","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/108689\/","title":{"rendered":"The rise of humanlike chatbots detracts from developing AI for the human good"},"content":{"rendered":"

Grok is a generative artificial intelligence (genAI) chatbot by xAI<\/a> that, according to Elon Musk, is \u201cthe smartest AI in the world<\/a>.\u201d Grok\u2019s latest upgrade is Ani, a porn-enabled anime girlfriend, recently joined by a boyfriend informed by Twilight and 50 Shades of Grey<\/a>.<\/p>\n

This summer, both xAI<\/a> and OpenAI<\/a> launched updated versions of their chatbots. Each touted improved performance, but more notably, new personalities. xAI introduced Ani; OpenAI rolled out a colder-by-default GPT-5 with four personas to replace its unfailingly sycophantic GPT-4o model<\/a>.<\/p>\n

Similar to claims made by Google DeepMind<\/a> and Anthropic<\/a>, both companies insist they\u2019re building AI to \u201cbenefit all humanity<\/a>\u201d and \u201cadvance human comprehension<\/a>.\u201d Anthropic claims, at least rhetorically, to be doing so responsibly<\/a>. But their design choices suggest otherwise. <\/p>\n

Instead of equipping every person with an AI assistant \u2014 a research collaborator with PhD-level intelligence<\/a> \u2014 some of today\u2019s leaders have released anthropomorphized AI systems that operate first as friends, lovers and therapists.<\/p>\n

Read more:
\n More people are considering AI lovers, and we shouldn’t judge<\/a><\/p>\n

As researchers and experts in AI policy and impact, we argue that what\u2019s being sold as scientific infrastructure increasingly resembles science fiction gone awry. These chatbots are engineered not as tools for discovery, but as companions designed to foster para-social, non-reciprocal bonds.<\/p>\n

Human\/non-human<\/p>\n

The core problem is anthropomorphism<\/a>: the projection of human traits onto non-human entities. As cognitive scientist Pascal Boyer explains, our minds are tuned to interpret even minimal cues in social terms<\/a>. What once aided our ancestors\u2019 survival now fuels AI companies by capturing the minds of their users<\/a>.<\/p>\n

\"a<\/a><\/p>\n

AI companies claim to work towards equipping every person with an AI-assistant.
\n (Matheus Bertelli\/Pexels), CC BY<\/a><\/p>\n

When machines speak, gesture or simulate emotion, they trigger those same evolved instincts such that, instead of recognizing it as a machine, users perceive it like a human. <\/p>\n

Nonetheless, AI companies have pushed on, building systems that exploit these biases<\/a>. The justification is that this makes interaction feel seamless and intuitive<\/a>. However, the consequences that result can render anthropomorphic design deceptive and dishonest<\/a>. <\/p>\n

Consequences of anthropomorphic design<\/p>\n

In its mildest form, anthropomorphic design prompts users to respond as if there were another human on the other side of the exchange, and can be as simple as saying \u201cthank you.\u201d<\/p>\n

The stakes grow higher when anthropomorphism leads users to believe the system is conscious: that it feels pain, reciprocates affection or understands their problems. Although new research reveals that it\u2019s possible the criteria for consciousness may be met in the future<\/a>, false attributions of consciousness and emotion have led to some extreme outcomes, such as leading users to marry their AI companions<\/a>.<\/p>\n

However, anthropomorphic design does not always inspire love. For others it has led to self-harm<\/a> or harming others<\/a> after forming unhealthy attachments. <\/p>\n

Some users even behave as though AI could be humiliated or manipulated, lashing out abusively as if it were a human target<\/a>. Recognizing this, Anthropic, the first company to hire an AI welfare expert<\/a>, has given its Claude models the unusual capacity to end such conversations<\/a>.<\/p>\n

Across this spectrum, anthropomorphic design pulls users away from leveraging AI\u2019s true capabilities, forcing us to confront the urgent question of whether anthropomorphism constitutes a design flaw \u2014 or more critically, a crisis.<\/p>\n

De-anthropomorphizing AI<\/p>\n

The obvious solution seems to be stripping AI systems of their humanity. American philosopher and cognitive scientist Daniel Dennett argued that this may be humanity\u2019s only hope<\/a>. But such a solution is far from simple because the anthropomorphization of these systems has already led users to form deep emotional attachments. <\/p>\n

When OpenAI replaced GPT-4o with GPT-5 as the default in ChatGPT, some users expressed genuine distress<\/a> and genuinely mourned the loss of 4o<\/a>. However, what they mourned was the loss of its prior speech patterns and the way it used language. <\/p>\n

\"a<\/a><\/p>\n

A public installation in Paris by the artist Rero.
\n (Mathias Reding\/Unsplash), CC BY<\/a><\/p>\n

This is what makes anthropomorphism such a problematic design model. As a result of the impressive language abilities of these systems, users attribute mentality to them<\/a> \u2014 and their engineered personas exploit this further. <\/p>\n

Instead of seeing the machine for what it is \u2014 impressively competent but not human \u2014 users read into its speech patterns. While AI pioneer Geoffrey Hinton warns that these systems may be dangerously competent<\/a>, something much more insidious seems to result from the fact these systems are anthropomorphized.<\/p>\n

Read more:
\n A neuroscientist explains why it’s impossible for AI to ‘understand’ language<\/a><\/p>\n

Flaw in the design<\/p>\n

AI companies are increasingly catering to people\u2019s AI companion desires, whether sexbot or therapist.<\/p>\n

Anthropomorphism is what makes these systems dangerous today because humans have intentionally built them to mimic us and exploit our instincts. If AI consciousness proves impossible, these design choices will be the cause of human suffering. <\/p>\n

But in a hypothetical world in which AI does attain consciousness, our choice to force it into a human-shaped mind \u2014 for our own convenience and entertainment, replicated across the world\u2019s data centres \u2014 may invent an entirely new kind, and scale, of suffering.<\/p>\n

Read more:
\n Increasingly sophisticated AI systems can perform empathy, but their use in mental health care raises ethical questions<\/a><\/p>\n

The real danger of anthropomorphic AI isn\u2019t some near or distant future where machines take over. The danger is here, now, and hiding in the illusion that these systems are like us.<\/p>\n

This is not the model that will \u201cbenefit all humanity\u201d (as OpenAI promises) or \u201chelp us understand the universe<\/a>\u201d (as xAI\u2019s Elon Musk claims). For the sake of social and scientific good, we must resist anthropomorphic design and begin the work of de-anthropomorphizing AI.<\/p>\n","protected":false},"excerpt":{"rendered":"Grok is a generative artificial intelligence (genAI) chatbot by xAI that, according to Elon Musk, is \u201cthe smartest…\n","protected":false},"author":2,"featured_media":108690,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-108689","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/108689","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=108689"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/108689\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/108690"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=108689"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=108689"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=108689"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}