{"id":779852,"date":"2026-09-23T10:06:14","date_gmt":"2026-09-23T10:06:14","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/779852\/"},"modified":"2026-09-23T10:06:14","modified_gmt":"2026-09-23T10:06:14","slug":"how-would-ai-actually-kill-all-humans-here-are-the-top-five-most-likely-scenarios-toby-walsh-for-the-conversation","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/779852\/","title":{"rendered":"How would AI actually \u2018kill all humans\u2019? Here are the top five most likely scenarios | Toby Walsh for the Conversation"},"content":{"rendered":"<p class=\"dcr-1s160rg\">Earlier this month, artificial intelligence researcher <a href=\"https:\/\/www.theguardian.com\/technology\/2026\/sep\/09\/anthropic-researchers-ai-human-extinction\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">Jacob Coxon resigned from Anthropic <\/a>after just four months. In an announcement on X, <a href=\"https:\/\/x.com\/hilbertspaess\/status\/2097476196791709843\" data-link-name=\"in body link\" rel=\"nofollow\">he stated<\/a>: \u201cThe people building AI earnestly believe that it could kill us all by the end of the decade.\u201d<\/p>\n<p class=\"dcr-1s160rg\">A senior member of Anthropic\u2019s staff, Evan Hubinger, actually agreed with Coxon, adding he personally thinks the chance of this happening in the next decade <a href=\"https:\/\/x.com\/EvanHub\/status\/2097497037956891126\" data-link-name=\"in body link\" rel=\"nofollow\">is more than 10%<\/a>.<\/p>\n<p class=\"dcr-1s160rg\">Understandably, <a href=\"https:\/\/theconversation.com\/we-really-do-earnestly-believe-ai-could-kill-all-humans-if-ai-labs-are-so-worried-about-ai-doom-why-dont-they-stop-291595\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">these statements made waves<\/a>. There\u2019s now lots of talk about <a href=\"https:\/\/theconversation.com\/big-ai-wants-to-slow-down-ai-research-is-it-a-safety-pause-or-a-strategic-retreat-291867\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">slowing down AI research<\/a> and increasing \u201c<a href=\"https:\/\/www.abc.net.au\/news\/2026-09-22\/australia-joins-global-push-for-ai-controls\/107179312\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">human control<\/a>\u201d over the technology.<\/p>\n<p class=\"dcr-1s160rg\">But how exactly might AI kill us all? There\u2019s no shortage of fantastical scenarios, and most of them involve the concept of \u201csuperintelligent\u201d AI \u2013 that is, AI that\u2019s more capable than humans.<\/p>\n<p class=\"dcr-1s160rg\">I\u2019ve distilled these scenarios down to the top five, ordering them roughly from most vague to most precise. And I\u2019d argue the list is also ordered from least to most probable.<\/p>\n<p>1. We\u2019ll never know<\/p>\n<p class=\"dcr-1s160rg\">AI doomers often justify their concerns by means of an annoying catch-22 paradox: how can we possibly imagine what a superintelligence might do to take out less intelligent beings like us?<\/p>\n<p class=\"dcr-1s160rg\">We\u2019d have to be superintelligent to predict what a superintelligence would be able to do. It\u2019s like asking your family dog to imagine thermonuclear war.<\/p>\n<p class=\"dcr-1s160rg\">The good news here is that superintelligence is still perhaps some distance away. Current AI models are really good at solving particular problems, but that\u2019s not the same as <a href=\"https:\/\/theconversation.com\/what-is-ai-superintelligence-could-it-destroy-humanity-and-is-it-really-almost-here-240682\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">being more intelligent than a human in all domains<\/a>.<\/p>\n<p class=\"dcr-1s160rg\">However, <a href=\"https:\/\/theconversation.com\/openai-may-have-solved-the-navier-stokes-equation-but-mathematics-is-more-than-1-million-trophy-hunts-291963\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">AI did recently solve one of the seven<\/a> most challenging maths problems known. It\u2019s apparently closing in on others, which might leave you feeling less optimistic here.<\/p>\n<p>2. Paperclips<\/p>\n<p class=\"dcr-1s160rg\">A superintelligent AI would probably be extraordinarily competent at achieving its goals. But it might be indifferent to human survival.<\/p>\n<p class=\"dcr-1s160rg\">A classic example of such indifference comes from <a href=\"https:\/\/en.wikipedia.org\/wiki\/Instrumental_convergence\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">Oxford philosopher Nick Bostrom\u2019s<\/a> imagined superintelligent AI that has been designed to optimise paperclip production. To produce its preferred form of office supplies, it quickly converts all available matter \u2013 including humans, planets and stars \u2013 into paperclips.<\/p>\n<p class=\"dcr-1s160rg\">What we have here is the perfect execution of improperly specified objectives. The AI doesn\u2019t hate humanity; it simply recognises we\u2019re composed of atoms that could be better utilised for paperclips. It\u2019s not personal.<\/p>\n<p class=\"dcr-1s160rg\">The good news here is that this scenario confuses intelligence with power. A superintelligent AI doesn\u2019t necessarily have the power to achieve its goals. Turning the planet into paperclip factories would require planning permissions.<\/p>\n<p class=\"dcr-1s160rg\">Even if it got the permissions, building too many paperclip factories would lead to inevitable public outcry. Interest groups would block the proceedings in the courts. Environmental activists would block the bulldozers.<\/p>\n<p class=\"dcr-1s160rg\">There\u2019s a lot of friction in the world that prevents even the very intelligent from imposing their will on the rest of us. In fact, you could think of datacentres as a current embodiment of the theoretical paperclip scenario. And humans are increasingly pushing back against <a href=\"https:\/\/theconversation.com\/data-centres-have-existed-for-decades-so-why-are-they-so-controversial-now-290253\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">turning the planet over to datacentres<\/a>.<\/p>\n<p>3. Bioweapons<\/p>\n<p class=\"dcr-1s160rg\">Humanity could be killed by a superintelligent AI making and releasing some dangerous new bioweapon into the atmosphere. This is, in fact, one outcome of <a href=\"https:\/\/ai-2027.com\/\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">the AI 2027 scenario<\/a> by the AI Futures Project, a non-profit dedicated to forecasting the impacts of advanced AI.<\/p>\n<p class=\"dcr-1s160rg\">This risk was made more concrete last month, when <a href=\"https:\/\/www.bbc.com\/news\/articles\/c5y3j3ngevmo\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">researchers at Stanford University announced<\/a> they\u2019d used a genetic language AI model to synthesise 16 new viruses.<\/p>\n<p class=\"dcr-1s160rg\">Worryingly, they just sent the genetic sequences off to a mail-order lab and it sent the viruses back in test tubes. The whole experiment cost a couple of hundred thousand dollars at most.<\/p>\n<p class=\"dcr-1s160rg\">The good news here is that it\u2019s <a href=\"https:\/\/blog.genesmindsmachines.com\/p\/im-sorry-youre-not-going-to-die-from\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">remarkably hard to kill <\/a><a href=\"https:\/\/blog.genesmindsmachines.com\/p\/im-sorry-youre-not-going-to-die-from\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">everyone<\/a><a href=\"https:\/\/blog.genesmindsmachines.com\/p\/im-sorry-youre-not-going-to-die-from\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\"> with a new virus<\/a>. To do that, you need a virus that\u2019s very transmissible, so it spreads far and wide. But it\u2019s a rule of biology \u2013 viruses that spread easily are typically less fatal. By contrast, if a virus is very fatal, transmissibility tends to go down, as most people infected die before there\u2019s time to spread the infection.<\/p>\n<p class=\"dcr-1s160rg\">Covid killed <a href=\"https:\/\/en.wikipedia.org\/wiki\/COVID-19_pandemic_deaths\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">less than 1% of humanity<\/a>. The deadliest pandemic in recorded history was the Black Death, when <a href=\"https:\/\/www.britannica.com\/event\/Black-Death\/Effects-and-significance\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">the plague killed more than one-third<\/a> of Europe\u2019s population in the 14th century. However, even the plague would be much less deadly today due to our increased medical knowledge and better sanitation.<\/p>\n<p>4. Nuclear war<\/p>\n<p class=\"dcr-1s160rg\">What if AI got into the nuclear command and control chain and started a nuclear war? We\u2019ve come <a href=\"https:\/\/www.chathamhouse.org\/2016\/07\/12-times-we-came-close-using-nuclear-weapons\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">close to nuclear war by mistake<\/a> several times in the past 50 years.<\/p>\n<p class=\"dcr-1s160rg\">We\u2019re told that nuclear command and control is completely disconnected from the internet. But, as we saw in 2010, Iran\u2019s nuclear centrifuges <a href=\"https:\/\/www.kaspersky.com\/resource-center\/definitions\/what-is-stuxnet\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">got taken out by a computer worm called Stuxnet<\/a>, thought to have been brought in on a USB stick. AI can also <a href=\"https:\/\/edition.cnn.com\/2026\/09\/18\/politics\/us-military-ai-false-intelligence-china-ship\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">give the military false intelligence<\/a>, which could lead to irreparable actions.<\/p>\n<p class=\"dcr-1s160rg\">The good news here is that nuclear stockpiles are down. <a href=\"https:\/\/livescience.com\/nuclear-war-could-kill-5-billion-from-famine\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">But they are still enough perhaps to take out half of us<\/a>. And it wouldn\u2019t be by the nuclear blast itself, but the famine in the nuclear winter that would follow.<\/p>\n<p>5. Other humans<\/p>\n<p class=\"dcr-1s160rg\">Perhaps the most likely risk is that we take ourselves out. And AI might precipitate this.<\/p>\n<p class=\"dcr-1s160rg\">Imagine \u2013 and it doesn\u2019t take a lot of imagination \u2013 that AI causes massive <a href=\"https:\/\/theconversation.com\/employment-data-shows-the-early-signs-of-ai-job-disruption-are-already-here-280273\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">job losses<\/a>, pollutes the information space <a href=\"https:\/\/theconversation.com\/how-we-tricked-ai-chatbots-into-creating-misinformation-despite-safety-measures-264184\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">with misinformation<\/a>, fractures our politics and destroys human relationships with <a href=\"https:\/\/theconversation.com\/china-has-cracked-down-on-ai-companions-what-can-we-learn-from-this-287976\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">fake synthetic companionship<\/a>.<\/p>\n<p class=\"dcr-1s160rg\">Society might easily break. Slowly but surely, we\u2019d stop being able to support human life at any scale.<\/p>\n<p class=\"dcr-1s160rg\">What then to take away from all these scenarios? There are some things to be worried about for sure. But not to be too worried, I hope.<\/p>\n<p class=\"dcr-1s160rg\"> Toby Walsh is professor of AI, research group leader at the University of New South Wales. He is the author of <a href=\"https:\/\/www.blackincbooks.com.au\/books\/god-ai\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">God AI: Boom or Doom? What to Expect When Machines Outsmart Us<\/a>. This article originally appeared in <a href=\"https:\/\/theconversation.com\/how-would-ai-actually-kill-all-humans-here-are-the-top-5-scenarios-292220\" data-link-name=\"in body link\" rel=\"nofollow noopener\" target=\"_blank\">the Conversation<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Earlier this month, artificial intelligence researcher Jacob Coxon resigned from Anthropic after just four months. In an announcement&hellip;\n","protected":false},"author":2,"featured_media":779853,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-779852","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/779852","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=779852"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/779852\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/779853"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=779852"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=779852"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=779852"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}