{"id":643430,"date":"2026-06-17T11:35:09","date_gmt":"2026-06-17T11:35:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/643430\/"},"modified":"2026-06-17T11:35:09","modified_gmt":"2026-06-17T11:35:09","slug":"will-it-take-a-chernobyl-scale-disaster-for-us-to-regulate-cyber-weapons-of-mass-destruction-stuart-russell","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/643430\/","title":{"rendered":"Will it take a \u2018Chernobyl-scale disaster\u2019 for us to regulate cyber weapons of mass destruction? | Stuart Russell"},"content":{"rendered":"

The AI company Anthropic has been making major headlines recently. Its trillion-dollar IPO plan<\/a> and its blood feud with secretary of defense Pete Hegseth<\/a> have attracted much attention, but two other events may be even more consequential.<\/p>\n

In early June, the company posted an article<\/a> describing early signs of recursive self-improvement (RSI), a process in which an AI system devises ways to increase its own intelligence, leading to a greater ability to improve itself, and so on.<\/p>\n

Obviously, uncontrolled RSI could produce a runaway feedback loop that leads to an irreversible loss of human control. Anthropic suggested the world should \u201cslow or temporarily pause frontier AI development\u201d. Then on 12 June, the White House issued an export control directive banning access to Anthropic\u2019s new frontier models, Fable 5 and Mythos 5, for all foreign nationals \u2013 including many of its own key researchers. Anthropic responded by shutting the models down altogether<\/a>.<\/p>\n

These two June events are closely related. A few months ago, Anthropic\u2019s Claude Code became good enough that its leading researchers no longer write any code at all; they just describe ideas and experiments to Claude and it does all the work.<\/p>\n

This sped up the cycle of improvement \u2013 including the improvement of Claude Code itself \u2013 to the point where the latest iteration, called Mythos 5, showed the ability to conduct end-to-end cyberattacks with no human assistance<\/a>. If such systems were released without cast-iron guardrails, almost anyone in the world could attack any country\u2019s critical infrastructure at will.<\/p>\n

These developments are only to be expected. They are symptoms of the inexorable increase in AI risk arising from the inexorable increase in AI capabilities. Yet, with the honorable exception of the UK\u2019s AI Safety Summit<\/a> in 2023, the world has largely been ignoring the risks.<\/p>\n

The CEOs are telling us: \u201cWe\u2019re on track to create superhuman intelligence, which has a good chance of causing human extinction.\u201d (By \u201cgood chance\u201d here, they mean a chance similar to the one in six chance of dying while playing Russian roulette with a loaded revolver; in this game, however, the revolver is pointed at all of our heads.) Yet governments reply: \u201cThat\u2019s wonderful! Can we offer you a subsidy? Fast-track your permits?\u201d<\/p>\n

But finally, with the prospect of weapons of mass cyberdestruction in the hands of billions, the White House has reversed its deregulatory stance and suffered a rare attack of common sense.<\/p>\n

They sputter: \u201cWhy did no one warn us about these AI systems?\u201d Their response has been spasmodic, with an on-again, off-again executive order<\/a> and now a ban on a system that had already been deployed, but the direction of travel is clear.<\/p>\n

Unrestrained development of unsafe systems leads to intolerable risks. Governments can respond now, before the risks materialize, or they can wait and clean up the mess (if they still exist, that is). One leading AI CEO told me he didn\u2019t expect serious regulation to happen until there was a \u201cChernobyl-scale disaster\u201d. If that happens, of course, the AI companies can expect to be shut down immediately and perhaps permanently.<\/p>\n

The recent changes in White House policy suggest we might not need a Chernobyl to spur real regulation, but perhaps only a Three Mile Island<\/a>. The kind of regulation we need is not new: a licensing regime that requires a minimum safety standard before a system can be built and released. This is how we handle nuclear power, airplanes, buildings, elevators, hairdressers and sandwich makers. Is it too much to ask of trillion-dollar AI corporations, who claim to be building the most dangerous technology in history?<\/p>\n

Stuart Russell is a distinguished professor of computer science<\/a> at University of California, Berkeley, the president of the International Association for Safe and Ethical Artificial Intelligence and a Guardian US columnist<\/p>\n","protected":false},"excerpt":{"rendered":"The AI company Anthropic has been making major headlines recently. Its trillion-dollar IPO plan and its blood feud…\n","protected":false},"author":2,"featured_media":643431,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-643430","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/643430","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=643430"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/643430\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/643431"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=643430"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=643430"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=643430"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}