{"id":907792,"date":"2026-09-27T21:08:14","date_gmt":"2026-09-27T21:08:14","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/907792\/"},"modified":"2026-09-27T21:08:14","modified_gmt":"2026-09-27T21:08:14","slug":"how-concerning-is-the-biological-weapon-threat-from-ai-systems","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/907792\/","title":{"rendered":"How concerning is the biological weapon threat from AI systems?"},"content":{"rendered":"<p class=\"paragraph_paragraph___QITb\">The AI industry is suddenly rife with existential fears, with senior figures claiming it could &#8220;kill us all&#8221; within a decade.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Dario Amodei, CEO of one of the world&#8217;s largest AI companies, Anthropic, has called for a &#8220;slowdown&#8221; of AI development to prevent it outrunning our control.<\/p>\n<p class=\"paragraph_paragraph___QITb\">One particular fear is that AI could develop a dangerous biological agent, or a bioweapon.<\/p>\n<p class=\"paragraph_paragraph___QITb\">At the same time, biologists are showing AI can help them with useful research \u2014 including those employed at Anthropic, who have just announced AI has helped them discover a new class of enzymes they claim &#8220;could represent <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/x.com\/DarioAmodei\/status\/2102831170299834652\" data-component=\"Link\" rel=\"nofollow\">a new gene editing mechanism<\/a>&#8220;.<\/p>\n<p class=\"paragraph_paragraph___QITb\">So is AI a biological threat, or a boon? It may be an uneasy mixture of both.<\/p>\n<p>Why does AI raise the danger of bioweapons?<\/p>\n<p class=\"paragraph_paragraph___QITb\">Labs around the world have had the tools to make dangerous biological agents, like viruses, for decades.<\/p>\n<p class=\"paragraph_paragraph___QITb\">But few people have known how to use those tools, and all of them are scientists who have spent years building their qualifications and credibility.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Brendan Walker-Munro, a security researcher at Southern Cross University, says AI changes this.<\/p>\n<p>&#8220;It&#8217;s lowering those knowledge barriers.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">David Heslop, a public health researcher at the University of New South Wales, says the speed of AI progress makes him &#8220;very concerned&#8221;.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;The tools are advancing at a rate which means that human oversight is becoming challenging,&#8221; Dr Heslop says.<\/p>\n<p><img decoding=\"async\" alt=\"Person sits in front of computer screens running code in a dark room.\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/09\/b445fdb171b81c224dcc402a62ad5b14.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">AI is moving at a pace that makes it hard for traditional biosecurity to keep up. (Unsplash: Jo\u00e3o Pessoa)<\/p>\n<p class=\"paragraph_paragraph___QITb\">An advanced AI model could give a user outside traditional systems the information required to make a bioweapon.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;It could be a virus or it could be a bacteria, it could be a fungus, it could be something we&#8217;ve never seen before.&#8221;<\/p>\n<p><a href=\"https:\/\/www.abc.net.au\/news\/2026-09-09\/anthropic-researcher-coxon-quits-over-human-threat\/107134164\" data-component=\"FullBleedLink\" class=\"RelatedCard_link__rsgR9 FullBleedLink_root__lTw_U interactive_focusContext__yRhc_ interactive_defaults__AKxUU FullBleedLink_showVisited__g3Xvz\" rel=\"nofollow noopener\" target=\"_blank\">Anthropic researcher says AI &#8216;could kill us all&#8217;<\/a><\/p>\n<p class=\"Typography_base__sj2RP RelatedCard_synopsis__cFwMW Typography_sizeMobile14__u7TGe Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">A researcher for AI developer Anthropic has quit the company and is calling on the industry to slow down.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Equally dangerously, in Dr Heslop&#8217;s opinion, an AI tool like a large language model (LLM) could help a bad actor plan to deploy dangerous material, including pre-existing viruses or toxins.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Such work would still need a level of expertise and tens of thousands of dollars of lab equipment.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;We&#8217;re not at the point, yet, where the LLM gives you a superpower,&#8221; Dr Heslop says.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;But it&#8217;s certainly something that could be done in a laboratory.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">AI could also be used to attack broader public health systems, like hospital infrastructure.<\/p>\n<p class=\"paragraph_paragraph___QITb\">David Kainer, a computational biologist at the University of Queensland, says the same tools applied to plant science could &#8220;potentially destroy large amounts of food production&#8221;.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;You could imagine something similar happening to engineer super-pathogens for crops.&#8221;<\/p>\n<p>What sorts of biological threats has AI enabled?<\/p>\n<p class=\"paragraph_paragraph___QITb\">There are several cases where AI has already been used to help design dangerous biological agents.<\/p>\n<p class=\"paragraph_paragraph___QITb\">In 2022, researchers at the Collaborations Pharmaceuticals company showed they could use their company&#8217;s AI software to <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.nature.com\/articles\/s42256-022-00465-9\" data-component=\"Link\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">make dangerous toxins<\/a>.<\/p>\n<p class=\"paragraph_paragraph___QITb\">The company&#8217;s AI tool was used to screen out drug candidates with high predicted toxicity. But the team found they could instruct it to do the opposite, designing new toxins in a matter of hours.<\/p>\n<p class=\"paragraph_paragraph___QITb\">In its recent <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.anthropic.com\/threat-intelligence-report-september-2026#biological-misuse-sep-26\" data-component=\"Link\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">threat intelligence report<\/a>, Anthropic highlighted five examples of people using its products &#8220;in ways that could support biological weapons development&#8221;.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Anthropic&#8217;s models were used to do things like draft grant applications and analyse data in research that made human viruses more contagious, and venoms and toxins more deadly.<\/p>\n<p class=\"paragraph_paragraph___QITb\">All of these users, according to Anthropic, were &#8220;working scientists&#8221; outside the US using unauthorised software to gain access to the US versions of their products.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Anthropic banned the users for violating supported region policies.<\/p>\n<p>Are there legitimate reasons for using AI?<\/p>\n<p class=\"paragraph_paragraph___QITb\">Biologists have used AI for positive purposes.<\/p>\n<p class=\"paragraph_paragraph___QITb\">AI program Alphafold, for instance, has been used to predict the shape of proteins for medicinal research, winning its creators the 2024 Nobel Prize in Chemistry.<\/p>\n<p class=\"paragraph_paragraph___QITb\">More recently, US researchers used generative AI to <a class=\"Link_link__kR0xA Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.abc.net.au\/news\/2026-08-07\/ai-models-design-viruses-not-found-in-nature-for-first-time\/107007854\" data-component=\"Link\" data-uri=\"coremedia:\/\/article\/107007854\" rel=\"nofollow noopener\" target=\"_blank\">design new bacteria-infecting viruses<\/a> that could become treatments against infection.<\/p>\n<p><img decoding=\"async\" alt=\"Close up of wheat crop\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/09\/9895db1db1df5c401a7f66399d856089.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">AI can help to build complex genetic networks that can be used to improve things like drought tolerance and yield in crops. (ABC Landline)<\/p>\n<p class=\"paragraph_paragraph___QITb\">Dr Kainer and his colleagues have developed an <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/flash-p.com\/\" data-component=\"Link\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">autonomous AI tool<\/a> to help with agricultural research.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Their tool collates vast amounts of data to make networks that biologists can use to predict how environmental or genetic changes might change a plant&#8217;s features.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;AI, if constructed and used correctly in a clever way, can do that process in an hour instead of six months,&#8221; Dr Kainer says.<\/p>\n<p><a href=\"https:\/\/www.abc.net.au\/news\/2026-09-13\/anthropic-ceo-calls-for-slower-ai-development\/107147650\" data-component=\"FullBleedLink\" class=\"RelatedCard_link__rsgR9 FullBleedLink_root__lTw_U interactive_focusContext__yRhc_ interactive_defaults__AKxUU FullBleedLink_showVisited__g3Xvz\" rel=\"nofollow noopener\" target=\"_blank\">Anthropic boss calls for AI slowdown<\/a><\/p>\n<p class=\"Typography_base__sj2RP RelatedCard_synopsis__cFwMW Typography_sizeMobile14__u7TGe Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Anthropic CEO Dario Amodei has called on AI firms to slow down the development of the powerful technology.\u00a0<\/p>\n<p class=\"paragraph_paragraph___QITb\">It&#8217;s not easy to tell if someone&#8217;s intentions are malicious when they use AI for biological research.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;The analyses you would try to do would look very similar, in my opinion, to work done for beneficial purposes,&#8221; Dr Kainer says.<\/p>\n<p class=\"paragraph_paragraph___QITb\">He believes controls put up by AI companies to prevent misuse are constraining biological work.<\/p>\n<p>&#8220;Right now, biologists are not reaping the benefits of the most powerful AI models that are commercially available.&#8221;What can reduce the risks?<\/p>\n<p class=\"paragraph_paragraph___QITb\">Commercial LLMs have safety controls designed to prevent their use for dangerous purposes.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Dr Heslop says these guardrails are the right step, but laws and regulations are needed as well.<\/p>\n<p>&#8220;I do have concerns that the various AI companies are not necessarily directly connected with our own legislative systems.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">But even if these guardrails hold, established companies aren&#8217;t the only providers of AI tools.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;Open-weight&#8221; models can be downloaded and run privately by anyone with a &#8220;bit of programming knowledge&#8221;, according to Dr Walker-Munro.<\/p>\n<p class=\"paragraph_paragraph___QITb\">Downstream controls, like increasing security on materials and equipment, can also lower the risks.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;There&#8217;s a difference between the capacity to do it and the capability to do it,&#8221; Dr Walker-Munro says.<\/p>\n<p><img decoding=\"async\" alt=\"Biohazard label\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/09\/deb68137ea8af6e0bcb0981a8518af0c.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">While AI can help people develop a plan, it&#8217;s still hard to get physical access to the materials needed to make and spread bioweapons. (Flickr: <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2 Link_underlineOnHover__Wg_BQ\" href=\"https:\/\/www.flickr.com\/photos\/diversey\/\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">Tony Webster<\/a>\/<a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2 Link_underlineOnHover__Wg_BQ\" href=\"https:\/\/www.flickr.com\/photos\/diversey\/17400246206\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">Biohazard<\/a>\/<a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2 Link_underlineOnHover__Wg_BQ\" href=\"https:\/\/creativecommons.org\/licenses\/by\/2.0\/deed.en\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">CC BY 2.0<\/a>)<\/p>\n<p class=\"paragraph_paragraph___QITb\">But Dr Heslop worries that barriers are getting lower as labs become more automated.<\/p>\n<p class=\"paragraph_paragraph___QITb\">He says other AI tools could be used for oversight, such as those <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.opcw.org\/media-centre\/news\/2026\/03\/opcw-releases-landmark-report-ai-and-chemical-weapons-convention\" data-component=\"Link\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">suggested by<\/a> the Organisation for the Prevention of Chemical Weapons.<\/p>\n<p><a href=\"https:\/\/www.abc.net.au\/news\/2026-09-15\/australia-needs-ai-warning-system-cyber-security-chief-says\/107151268\" data-component=\"FullBleedLink\" class=\"RelatedCard_link__rsgR9 FullBleedLink_root__lTw_U interactive_focusContext__yRhc_ interactive_defaults__AKxUU FullBleedLink_showVisited__g3Xvz\" rel=\"nofollow noopener\" target=\"_blank\">Australian AI &#8216;early warning system&#8217;<\/a><\/p>\n<p class=\"Typography_base__sj2RP RelatedCard_synopsis__cFwMW Typography_sizeMobile14__u7TGe Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Australian Signals Directorate director-general Abigail Bradshaw says the nation needs an AI &#8220;early warning system&#8221; to help defend against the increasingly powerful technology.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;You could have an AI buddy that is checking your work and is a requirement for doing this work,&#8221; Dr Heslop proposes.<\/p>\n<p class=\"paragraph_paragraph___QITb\">&#8220;It sounds intrusive, but in truth it probably wouldn&#8217;t get in the way of legitimate research.&#8221;<\/p>\n<p class=\"paragraph_paragraph___QITb\">But, Dr Walker-Munro cautions, restrictions can still hinder useful research.<\/p>\n<p>&#8220;It&#8217;s about a conversation between government, academia, industry and the AI providers to come up with a system that recognises that tension.&#8221;<\/p>\n","protected":false},"excerpt":{"rendered":"The AI industry is suddenly rife with existential fears, with senior figures claiming it could &#8220;kill us all&#8221;&hellip;\n","protected":false},"author":2,"featured_media":907793,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,475983,475985,475988,254,475984,255,64,63,9326,475982,475986,475987,105],"class_list":["post-907792","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-ai-bioweapon-risk","tag-ai-designed-bioweapons","tag-ai-models-bioweapon-safeguards","tag-artificial-intelligence","tag-artificial-intelligence-biosecurity-threat","tag-artificialintelligence","tag-au","tag-australia","tag-biosecurity","tag-bioweapon","tag-can-ai-create-bioweapons","tag-how-ai-could-be-used-to-create-bioweapons","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/907792","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=907792"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/907792\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/907793"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=907792"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=907792"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=907792"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}