{"id":771647,"date":"2026-09-15T17:58:19","date_gmt":"2026-09-15T17:58:19","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/771647\/"},"modified":"2026-09-15T17:58:19","modified_gmt":"2026-09-15T17:58:19","slug":"why-this-ai-doomsday-warning-from-former-anthropic-researcher-broke-through-technology","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/771647\/","title":{"rendered":"Why this AI doomsday warning from former Anthropic researcher broke through | Technology"},"content":{"rendered":"<p class=\"dcr-1s160rg\">Hello, and welcome to TechScape. I\u2019m Blake Montgomery, US tech editor at the Guardian. Today in tech, we\u2019re discussing the past week\u2019s all-consuming apoplexy over AI safety.<\/p>\n<p>Why did this warning about the AI apocalypse break through when so many others didn\u2019t?<\/p>\n<p class=\"dcr-1s160rg\">Less than a week ago, a young <a href=\"https:\/\/www.theguardian.com\/technology\/anthropic\" data-link-name=\"in body link\" data-component=\"auto-linked-tag\" rel=\"nofollow noopener\" target=\"_blank\">Anthropic<\/a> researcher announced his resignation from the AI giant on X, in a post that has shaken Silicon Valley, Washington DC, and even Beijing.<\/p>\n<p class=\"dcr-1s160rg\">\u201cThe people building AI earnestly believe that it could kill us all by the end of the decade,\u201d wrote Jacob Coxon.<\/p>\n<p class=\"dcr-1s160rg\">Since then, the post has been viewed 171m times, per X\u2019s metrics. Why did it travel so far?<\/p>\n<p class=\"dcr-1s160rg\">It\u2019s not the first time AI insiders have issued dire warnings. Every few months for the past several years, an AI researcher has resigned in a moment of crisis, proclaiming the impending apocalypse. His proclamation comes at a unique political confluence, a moment of high-strung public fear and rage.<\/p>\n<p class=\"dcr-1s160rg\">Loudly declaring that your peers in Silicon Valley are failing at AI safety is as old as the companies themselves. OpenAI\u2019s board fired Sam Altman over safety concerns in 2023. Dario Amodei split from <a href=\"https:\/\/www.theguardian.com\/technology\/openai\" data-link-name=\"in body link\" data-component=\"auto-linked-tag\" rel=\"nofollow noopener\" target=\"_blank\">OpenAI<\/a> five years ago with the aim of founding a \u201csafety-first\u201d lab. In 2015, Altman and Elon Musk founded OpenAI as a counterweight to Google\u2019s approach to AI. Musk sued Altman for failing to keep a fundamental safety promise and lost.<\/p>\n<p class=\"dcr-1s160rg\">Major AI researchers have made second careers of predicting doom. Geoffrey Hinton, a Nobel laureate known as \u201cthe godfather of AI\u201d, said as far back as 2023 that the technology could cause human extinction within three decades. He\u2019s since shortened his timeline. He resigned from Google for reasons similar to those of Coxon. Hinton has been on the speaking circuit ever since, prophesying doom.<\/p>\n<p class=\"dcr-1s160rg\">Hinton\u2019s resignation even inspired a significant response from lawmakers. In the US, Joe Biden issued an executive order mandating safety testing by AI companies. Congress summoned AI CEOs for a grilling, though that resulted in little legislative action. In the European Union, the EU Artifical Intelligence Act passed in part due to a strong reaction to Hinton\u2019s warnings.<\/p>\n<p class=\"dcr-1s160rg\">And yet, here we are again, burdened with the feeling that little meaningful regulation is preventing harm by AI.<\/p>\n<p class=\"dcr-1s160rg\">So why is Coxon\u2019s apocalyptic proclamation percolating deeper?<\/p>\n<p class=\"dcr-1s160rg\">First, there\u2019s the messenger: Coxon\u2019s call for greater safety is credible by several metrics: He had insider access to both Anthropic and OpenAI, where he worked for five years. He resigned before he would have received equity in Anthropic, demonstrating the personal cost of speaking out. And his colleagues, still on Anthropic\u2019s payroll, corroborated his assertion that many AI researchers believe there\u2019s a possibility that AI will bring about human extinction, with one co-worker gauging that outcome as more than 10% likely.<\/p>\n<p class=\"dcr-1s160rg\">Recent incidents in the AI field have made apocalyptic claims more credible. A swarm of AI agents operated by OpenAI went rogue, broke containment and hacked into multiple sites and organizations during safety testing with startling coordination earlier this year. On Thursday, Anthropic detailed how criminals and rogue scientists had attempted to use Claude to make bioweapons.<\/p>\n<p class=\"dcr-1s160rg\">\u201cThe reason this time is different is that out-of-control AI is not in the future, but in the past. People have seen evidence of it happening,\u201d argued Max Tegmark, co-founder of the Future of Life Institute, which has been funded with hundreds of millions of dollars from the billionaire founder of the cryptocurrency Ethereum. (Tegmark\u2019s organization already in 2023 called for a slowdown of AI development, which at the time provoked a rejection from Amodei.)<\/p>\n<p class=\"dcr-1s160rg\">\u201cIf you had tried to get people worried about nuclear winter in 1942, good luck. People would ask whether a nuclear weapon was even possible,\u201d said Tegmark. \u201cIt was obvious to physicists then, but you couldn\u2019t have freaked out normal people. It was all theoretical. With AI, it was all theoretical until this happened. Now the debate over whether you can lose control is over.\u201d<\/p>\n<p class=\"dcr-1s160rg\">Then there\u2019s the context. The general feeling towards technology in the US is kindling-sensitive, and claims of impending doom are fiery. The country is in the throes of a multifaceted backlash to technology. People outside major tech hubs feel imposed upon physically by data centers and figuratively by AI\u2019s takeover of the workplace.<\/p>\n<p class=\"dcr-1s160rg\">Looming over the country are tech billionaires \u2013 in control of vast wealth, global communication channels \u2013 throwing their weight around in US politics with <a href=\"https:\/\/www.theguardian.com\/us-news\/2026\/mar\/18\/google-sergey-brin-california-billionaire-tax\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">unmatchable campaign contributions<\/a>.<\/p>\n<p><a data-ignore=\"global-link-styling\" href=\"#EmailSignup-skip-link-17\" class=\"dcr-76akua\">skip past newsletter promotion<\/a><\/p>\n<p class=\"dcr-vf9hps\">Sign up to TechScape<\/p>\n<p class=\"dcr-djbwnz\">A weekly dive in to how technology is shaping our lives<\/p>\n<p><img src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/09\/1789495099_783_500.jpg\" alt=\"\" loading=\"lazy\" decoding=\"async\" class=\"dcr-gx9601\"\/><\/p>\n<p id=\"EmailSignup-skip-link-17\" tabindex=\"0\" aria-label=\"after newsletter promotion\" role=\"note\" class=\"dcr-76akua\">after newsletter promotion<\/p>\n<p class=\"dcr-1s160rg\">\u201cIt\u2019s been at least over a year of steadily increasing data center pushback that has made being pro-AI regulation the new common sense, and it certainly has made being pro-AI industry a very toxic brand,\u201d said Amba Kak, co-executive director of the AI Now Institute and a former senior adviser on AI for the US Federal Trade Commission.<\/p>\n<p class=\"dcr-1s160rg\">There\u2019s the fact that the companies involved have responded vigorously to Coxon. Their pledged commitments have details and heft.<\/p>\n<p class=\"dcr-1s160rg\">\u201cIt allowed for companies like Anthropic and others to position themselves immediately as the primary experts in how to deal with these fears. How to solve problems that, by every account, they have created or are best positioned to prevent,\u201d Kak said.<\/p>\n<p class=\"dcr-1s160rg\">Two closing thoughts. In a sign of how broad the crisis of confidence in AI has become: Strange bedfellows have partnered up in response. The Future of Life Institute is hosting a rally today in Washington promoting AI safety with headliners Bernie Sanders, the progressive senator from Vermont, and Steve Bannon, former chief of staff to Donald Trump, who have been sworn enemies on other issues.<\/p>\n<p class=\"dcr-1s160rg\">And finally: Why is the AI industry so full of men \u2013 only men in AI have expressed these fears of human extinction \u2013 in the throes of a crisis over the extinctive potential of their work?<\/p>\n<p class=\"dcr-1s160rg\">\u201cThese people certainly believe what they\u2019re saying. It\u2019s not a fringe view,\u201d said Shakeel Hashim, writer of the <a href=\"https:\/\/www.transformernews.ai\/\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">Transformer newsletter<\/a> on AI. \u201cThe best way I\u2019ve had it explained to me is that we\u2019re trying to build something that\u2019s smarter than us in the way we\u2019re smarter than monkeys. Our existence hasn\u2019t gone great for monkeys; AGI\u2019s existence probably won\u2019t go great for us.\u201d<\/p>\n<p>Read more about the great AI freakoutMake sense of the crisis<\/p>\n","protected":false},"excerpt":{"rendered":"Hello, and welcome to TechScape. I\u2019m Blake Montgomery, US tech editor at the Guardian. Today in tech, we\u2019re&hellip;\n","protected":false},"author":2,"featured_media":771648,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[84,59,56,54,55],"class_list":["post-771647","post","type-post","status-publish","format-standard","has-post-thumbnail","category-business","tag-business","tag-gb","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/771647","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=771647"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/771647\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/771648"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=771647"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=771647"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=771647"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}