{"id":767476,"date":"2026-09-11T17:22:12","date_gmt":"2026-09-11T17:22:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/767476\/"},"modified":"2026-09-11T17:22:12","modified_gmt":"2026-09-11T17:22:12","slug":"tech-whistleblowers-warn-ai-could-wipe-out-humanity-doomspeak-or-not-we-must-take-these-claims-seriously-gaby-hinsliff","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/767476\/","title":{"rendered":"Tech whistleblowers warn AI could wipe out humanity. Doomspeak or not, we must take these claims seriously | Gaby Hinsliff"},"content":{"rendered":"

Another day, another horseman of the apocalypse galloping over the horizon. Lately we have heard from so many AI doomers \u2013 tech whistleblowers popping up to warn that their work is probably going to kill us<\/a> \u2013 that we\u2019re becoming almost blase about it. Humanity wiped out within a decade? Well, only if another world war or the climate crisis doesn\u2019t get us first. Since it\u2019s never clear whether the tech threat is real, or just a twisted form of hype from an industry that drums up investment by making their products sound more powerful than they really are, most of us settle for trying not to think about it too hard.<\/p>\n

But something about the AI researcher Jacob Coxon\u2019s very public resignation<\/a> from the cutting-edge American lab Anthropic, via a post on X arguing that he can\u2019t keep working for companies \u201cgambling with our lives\u201d, has cut through where bigger names have not. Most chillingly, he claimed that colleagues still at Anthropic aren\u2019t staying because they think he\u2019s wrong about the dangers of pursuing self-improving super intelligence \u2013 the holy grail of machines that are not just smarter than humans but capable of building their own even more powerful successors, evolving independently of humans \u2013 but because they\u2019re afraid of ceding the field to people with fewer scruples. His colleagues, Coxon said, talk routinely about the \u201cendgame\u201d or the \u201ccrunch time<\/a>\u201d, meaning that what they do in the next year or two will decide the fate of humanity. Whether that\u2019s true or simply self-aggrandising techbro delusion, what he describes is an industry now practically begging to be saved from itself.<\/p>\n

The frisson of alarm<\/a> over AI running through Westminster this week was real, sharpened by news of Anthropic \u2013 which pitches itself as being more safety-conscious than its rivals OpenAI \u2013 declining for the first time to submit a new model for scrutiny by Britain\u2019s AI safety watchdog<\/a>. We are now entering a far more disruptive era of AI, dominated not by relatively basic chatbots but by agents designed to undertake tasks on humans\u2019 behalf, making their own decisions about how to complete them. Unfortunately, it turns out even basic life admin requires the kind of fine judgments that come instinctively to humans but seem remarkably hard to codify for machines.<\/p>\n

Take the over-zealous agent tasked recently by its Australian client with booking him into a pilates class, which responded to finding the class full by hacking the gym\u2019s website<\/a> and booting other people off the waiting list. Now imagine it blundering into something more life-threatening than a gym class. When Coxon says his industry hasn\u2019t fixed problems with alignment, and when OpenAI\u2019s chief scientist warned last week<\/a> that no lab had solved them well enough to carry on scaling this fast much longer, what they\u2019re talking about is this failure to replicate in machines the values and assumptions humans apply to decisions without even really knowing they\u2019re doing it \u2013 including the sense of how far it\u2019s justifiable to go in getting what you want.<\/p>\n

A series of reported escapes by agents<\/a> supposedly confined to OpenAI\u2019s lab for testing, some of which contrived to access the internet behind their human supervisors\u2019 backs and conduct real-world cyber-attacks, has meanwhile raised serious questions over the industry\u2019s ability even to experiment safely. (Unnervingly, Coxon says newer models seem to know when they\u2019re being tested, making it easier for them to deceive researchers.)<\/p>\n

And agents don\u2019t have to acquire anything like super intelligence to threaten human life: think how easily a cyber-attack on air traffic control, or NHS data systems, or even water purification systems could cause mass fatalities.<\/p>\n

What\u2019s happening in some frontier AI labs now is arguably the equivalent of the Manhattan Project that built the atomic bomb, but this time led by private companies in a mad dash for wealth and market dominance, not scientists under an elected government\u2019s command. Britons meanwhile got more say in sugar taxes on junk food than we\u2019re getting over regulating something theoretically capable of rendering us extinct.<\/p>\n

Given time, of course, it might prove possible to replicate in machines the vast ecosystem of social ties, moral codes, intensive parenting and state policing that humans have developed to stop us behaving like sociopaths. (Only this week, Google\u2019s DeepMind<\/a> reported an experiment where 100 agents were given a maths problem and told not to cheat: though a minority promptly did cheat, a larger group either snitched on them to the humans or helped devise technical fixes.) But time is the one thing nobody dares to give themselves in the middle of an arms race, which is why it\u2019s high time for governments to act. We need an international agreement to press pause<\/a>, not on AI research as a whole, but on the riskiest projects, until we better understand whether it will ever be possible to mitigate the dangers or control the results. Since it\u2019s hard to imagine Donald Trump voluntarily sacrificing US geopolitical or commercial advantage over China for the good of humanity, leadership may have to come for now not from above but below, where industry insiders spooked by their own work are making common cause with the rest of us.<\/p>\n

More Americans are now concerned than excited<\/a> about AI, according to polling this summer from the Pew Research Center \u2013 and unusually it\u2019s the young who are most hostile, afraid it will not only take their jobs but make it harder to form relationships or think creatively. (That\u2019s what growing up on social media seemingly does for trust in tech.) Even big business seems increasingly sceptical, with almost two-thirds of international executives surveyed by the consultants McKinsey this summer reporting no measurable impact on earnings<\/a> from using the admittedly basic AI tools now available to them.<\/p>\n

Warnings about an AI bubble triggering another 2008-style global financial crash<\/a> haven\u2019t helped, while plans to build giant, energy-guzzling datacentres are meeting angry local resistance<\/a> on both sides of the Atlantic from people who can\u2019t see what\u2019s in it for them. Pressing pause on potential Armageddon looks in the circumstances less like the luddite option, and more like a smart way for tech companies to avoid a full-on backlash that will sweep away the good with the bad.<\/p>\n

skip past newsletter promotion<\/a><\/p>\n

Sign up to Matters of Opinion<\/p>\n

Guardian columnists and writers on what they\u2019ve been debating, thinking about, reading, and more<\/p>\n

\"\"<\/p>\n

But if the AI doomers are right, then the window to do so may not always be open. It\u2019s time for humans to stop and think about what we\u2019re doing to ourselves \u2013 while we alone still have the power to do so.<\/p>\n","protected":false},"excerpt":{"rendered":"Another day, another horseman of the apocalypse galloping over the horizon. Lately we have heard from so many…\n","protected":false},"author":2,"featured_media":767477,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-767476","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/767476","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=767476"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/767476\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/767477"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=767476"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=767476"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=767476"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}