{"id":585176,"date":"2026-08-30T19:02:09","date_gmt":"2026-08-30T19:02:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/585176\/"},"modified":"2026-08-30T19:02:09","modified_gmt":"2026-08-30T19:02:09","slug":"ais-worst-disasters-will-arrive-unannounced-ai-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/585176\/","title":{"rendered":"AI\u2019s worst disasters will arrive unannounced | AI (artificial intelligence)"},"content":{"rendered":"

Timothy Garton Ash is right that serious artificial intelligence risks demand international action, but \u201cAI Hiroshima\u201d may be the wrong picture (Would even an AI disaster on the scale of Hiroshima be enough to make humankind protect itself? I fear not, 22 August<\/a>). Hiroshima was not technology going rogue. Human beings designed the bomb, authorised its use and dropped it. The technology worked much as\u00a0intended.<\/p>\n

AI may one day behave in ways we cannot control, but many of the gravest harms could happen without any dramatic moment when \u201cthe AI takes over\u201d. AI might help design a pathogen, find a vulnerability in critical infrastructure or improve a weapons system while people still decide what happens next. Other harms may build almost invisibly through thousands of ordinary decisions \u2013 more autonomy here, one safeguard removed there, another consequential task handed over because the system has worked well so far. By the time the danger is obvious, the important decisions may already have been made.<\/p>\n

That is also where international agreement could begin. We do not need countries to agree about superintelligence or the probability of human extinction before agreeing that there are some doors AI should never be allowed to open by itself. Weapons systems, critical infrastructure and biological synthesis are obvious places to start. Governments could agree minimum safeguards, require clear human authority for the most\u00a0consequential actions, keep records of who authorised what and share serious failures and near-misses internationally.<\/p>\n

The greatest AI dangers may not arrive with a mushroom cloud. They may arrive quietly, one apparently reasonable step at a time. If we want effective AI governance, we need to fight the right battle, not the\u00a0most\u00a0cinematic one.
Dr Simon Nieder
Chesterfield, Derbyshire<\/p>\n

Prof Jonathan Michie (Letters, 26 August<\/a>) reminds us that the Serbelloni group, led by the author\u2019s father, Donald Michie (when he was at Edinburgh University), was weighing the social dangers of artificial intelligence as long ago as 1972. Nor is AI technology itself new, since its roots run back through to Frank Rosenblatt\u2019s perceptron<\/a> of 1957, to the Dartmouth workshop<\/a> of 1956, and to Alan Turing before that. What is new is that we now have the hardware and software infrastructures to drive it forward at what can sometimes seem to be a terrifying speed.<\/p>\n

The Lighthill report of 1973 duly delivered an AI winter in the UK, and the field\u2019s centre of gravity crossed the Atlantic, with the consequences that we all now live with. Donald Michie had worked alongside Turing at Bletchley Park and argued forcefully against the cuts, in the televised Lighthill debate that followed the report, to no avail. The quip attributed to him, perhaps apocryphally, \u201cLet there be Lighthill. And there was darkness\u201d, still resonates strongly in our country today.<\/p>\n

As a double-hatted academic (computer scientist and humanities scholar), I would argue for the return of a \u201cSerbelloni debate\u201d that, as Jonathan Michie observes and as his father recognised, requires the involvement of both the sciences and the humanities.
Dr Anthony Harris
Emmanuel College, Cambridge<\/p>\n

In his article about regulating AI (I worked at OpenAI. Here are the guardrails we need now, 21 August<\/a>), Miles Brundage failed to mention an international effort seeking broad political support for a global AI treaty<\/a>. This effort is carrying forward a compelling address at the inaugural UN Global Dialogue on AI Governance<\/a> in Geneva last month, where the secretary general called for human control of AI as its applications spread in weaponry and subversive, prejudicial public surveillance<\/p>\n

A fragmented approach, as described by Mr Brundage, is likely to greatly increase the difficulty of implementing AI controls that are timely, internationally negotiated, and therefore effective.<\/p>\n

AI, corporate agendas, diverse national defence and economic goals, and the proliferation of energy-intensive datacentres are entangled in interlocking systemic interrelationships that cannot be resolved through disjointed incrementalism. This is especially true as the pace of innovation accelerates, exacerbating worst-case scenarios of advanced AI technology, posing increasingly dire risks.<\/p>\n

No matter how well intended, fragmented efforts will be diversionary and cause crucial delays, impeding the diligent pursuit of a systemic global strategy to pre-empt destructive outcomes. Such outcomes could result from malicious use of AI by humans and\/or subversive and deceptive activities of renegade algorithms \u2013 examples of which are already alarming.<\/p>\n

Another troubling aspect of this systemic dilemma must be addressed. Mounting bipartisan opposition to datacentres \u2013 well-justified and well-substantiated \u2013 is diverting the political attention needed to control AI and implement appropriate restraints (bans or moratoriums) until reliable AI safeguards can be established. This is analogous to focusing on treating a serious symptom in lieu of urgently seeking a remedy for the critical disease that\u2019s causing it. Surely it\u2019s possible to employ a multifaceted strategy, recognising that the sooner rigorous AI guardrails are established, the fewer datacentre harms will be suffered.<\/p>\n

Like climate change, the threats of advanced AI are inherently global, making an international approach essential.
David Kyler
Saint Simons Island, Georgia, US <\/p>\n

Have an opinion on anything you\u2019ve read in the Guardian today? Please email<\/a> us your letter and it will be considered for publication in our letters<\/a> section.<\/p>\n","protected":false},"excerpt":{"rendered":"Timothy Garton Ash is right that serious artificial intelligence risks demand international action, but \u201cAI Hiroshima\u201d may be…\n","protected":false},"author":2,"featured_media":585177,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":["post-585176","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-new-zealand","tag-newzealand","tag-nz","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/585176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=585176"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/585176\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/585177"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=585176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=585176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=585176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}