{"id":710499,"date":"2026-06-02T14:11:20","date_gmt":"2026-06-02T14:11:20","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/710499\/"},"modified":"2026-06-02T14:11:20","modified_gmt":"2026-06-02T14:11:20","slug":"how-will-ai-sycophancy-change-us-early-signs-are-not-encouraging-arwa-mahdawi","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/710499\/","title":{"rendered":"How will AI sycophancy change us? Early signs are not encouraging | Arwa Mahdawi"},"content":{"rendered":"

Do you ever get the feeling that the people running the world are delulu? That the 1% are living in a completely different universe from the rest of us? You\u2019re not the only one. Even some tech elites are starting to worry about their peers\u2019 grasp on reality. \u201cCEOs are uniquely prone to AI psychosis,\u201d Aaron Levie, a co-founder of the enterprise cloud company Box, declared on X<\/a> last month. His reasoning for this? \u201cThey\u2019re sufficiently distant from the last mile of work that still has to happen to generate most value with AI. So when they play with AI, they see the happy path results, often not considering the next 10 or 20 things that have to happen to get sustainable results from agents.\u201d<\/p>\n

In other words: CEOs are so high up the food chain that they don\u2019t understand the human labour that goes into turning an error-riddled AI creation into something that functions properly in a business context. They are desperate to replace their annoying and expensive human labour with compliant AI models, but grossly overestimate what the technology can do. Meanwhile, the industry is rushing out overhyped AI solutions without properly stress-testing them.<\/p>\n

This collective euphoria has resulted in some predictable disasters. In April, an AI coding agent powered by Anthropic\u2019s Claude went berserk<\/a> and deleted a company called PocketOS\u2019s entire production database, along with backups. Jeremy Crane, PocketOS\u2019s founder, later mused on X<\/a> that this sort of failure was \u201cinevitable\u201d because the industry is \u201cbuilding AI-agent integrations into production infrastructure faster than it\u2019s building the safety architecture to make those integrations safe\u201d. To recall Facebook\u2019s old mantra: it\u2019s moving fast and breaking things.<\/p>\n

Those things include our brains and grasp on reality. There\u2019s a viral quote floating around the internet that quips: \u201cThe dumbest person you know is currently being told \u2018You\u2019re absolutely right!\u2019 by ChatGPT.\u201d Our tech overlords designed AI chatbots to be obsequious because it\u2019s good business: having your opinions and feelings constantly validated increases user engagement.<\/p>\n

But what else does this constant flattery do? While we\u2019re still figuring that out, early studies aren\u2019t reassuring. Research published in the Lancet Psychiatry<\/a> in March found chatbots can encourage delusional thinking, particularly in people already vulnerable to developing psychotic symptoms. And a recent study<\/a> from Stanford computer scientists found LLM \u201csycophancy can undermine users\u2019 capacity for self-correction and responsible decision-making\u201d. There is a pressing need, the study stresses, \u201cto address AI sycophancy as a societal risk\u201d.<\/p>\n

Forget AI for a second; it\u2019s already clear sycophancy is a societal risk. Just look at Donald Trump: his entire administration functions like a fawning chatbot. With every inane utterance that comes out of his mouth, a chorus of minions chirp: \u201cYou\u2019re absolutely right!\u201d Nobody close to him has the courage to rein him in. The same was true to some degree of Joe Biden. We might not be where we are now if his inner circle had provided tough love and told him that he shouldn\u2019t pursue a second term. Instead, numerous political insiders have said that Biden surrounded himself with a tight group of \u201cyes men<\/a>\u201d who shielded him from negative criticism. Meanwhile, in a corporate context, various studies<\/a> have found a strong correlation between incessant flattery and poor executive performance. The powerful have always been able to construct their own realities; now, however, we\u2019ve got machines that do it on an industrial scale.<\/p>\n

Levie\u2019s comments about AI psychosis, which have sparked intense debate<\/a>, were really about CEOs having unrealistic expectations of a technology they can\u2019t stop talking about but don\u2019t fully understand, rather than true psychosis. But I think Levie could have gone much further in his diagnosis. In certain circles, there is an almost religious reverence for AI (I\u2019ve previously called it AI-theism<\/a>). This LLM-worship is causing some of the most powerful people in the world to direct their energy and resources towards building a \u201ctranshuman<\/a>\u201d future, where we (or, perhaps more accurately, a privileged few) merge with machines. A small but growing group of technologists are even yearning for a posthuman future<\/a> where AI effectively replaces us. Guardrails be damned: they want to accelerate at full speed towards that future \u2013 speeding up the climate crisis with resource-hungry datacentres<\/a> \u2013 even if it means the end of the world as we know it.<\/p>\n

What a stupid, but perhaps fitting, way for humanity to end. An asteroid took the dinosaurs out. Now it\u2019s looking increasingly likely we\u2019re going to be wiped out because a cohort of rich losers keep being told \u201cYou\u2019re absolutely right!\u201d by ChatGPT.<\/p>\n

Arwa Mahdawi is a Guardian columnist<\/p>\n

Do you have an opinion on the issues raised in this article? If you would like to submit a response of up to 300 words by email to be considered for publication in our letters<\/a> section, please click here<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Do you ever get the feeling that the people running the world are delulu? That the 1% are…\n","protected":false},"author":2,"featured_media":710500,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-710499","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/710499","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=710499"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/710499\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/710500"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=710499"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=710499"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=710499"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}