{"id":914595,"date":"2026-10-03T11:32:12","date_gmt":"2026-10-03T11:32:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/914595\/"},"modified":"2026-10-03T11:32:12","modified_gmt":"2026-10-03T11:32:12","slug":"why-a-decade-of-ai-safety-promises-keep-failing-to-bite","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/914595\/","title":{"rendered":"Why a decade of AI safety promises keep failing to bite"},"content":{"rendered":"

Earlier this week, United States president Donald Trump and representatives of six of the world\u2019s most powerful tech companies signed the White House Accord on Super Intelligence<\/a>. <\/p>\n

The statement begins: \u201cWe believe that every company is responsible for developing its own technology safely,\u201d then lays out a four-point plan for self-regulation by frontier AI companies.<\/p>\n

The accord is a response to growing concerns, voiced by many tech bosses, academics and company insiders, that AI agents could soon be beyond human control, with some even claiming a 10% chance of AI wiping out humanity by the end of the decade<\/a>. This follows high-profile hack attempts by AI agents on Canadian<\/a> and Australian<\/a> government websites. <\/p>\n

The international political community has also responded. At the United Nations General Assembly last week, 22 world leaders signed a new AI safety declaration calling for an international AI safety regulator<\/a>. <\/p>\n

These public statements have grabbed headlines, but they are hardly novel. The recent history of AI is littered with similar declarations from governments and private industry making commitments to AI safety. <\/p>\n

Ten years of agreements \u2013 and little change<\/p>\n

Ten years ago, the Partnership on AI<\/a> was formed to \u201caddress important questions about our future with AI\u201d. Four of the six White House accord signatories are members, including Anthropic and OpenAI. <\/p>\n

The partnership has published guidance for the safe deployment of foundation models<\/a>, which includes a recommendation of \u201ctimely and responsible reporting of safety incidents\u201d. When an OpenAI agent breached Medicare\u2019s Statistics Reporting Service<\/a> in June, it took three months for the company to notify the Australian government. A cynic might see this as evidence that tech companies regulating themselves is not working. <\/p>\n

Governments too have signed plenty of AI safety agreements. In 2023, 28 countries and the European Union signed the Bletchley Declaration<\/a> at the inaugural AI Safety Summit at Bletchley Park, in the UK. One prescient comment from the declaration: \u201cWe are especially concerned by risks in domains such as cybersecurity.\u201d <\/p>\n

The content of the Bletchley statement in 2023 and last week\u2019s UN agreement are strikingly similar. Both call for shared international standards, strong human control, and shared responsibility between governments, industry and civil society. <\/p>\n

Again, a cynic might ask why, if governments called for a change in approach in 2023, was there a need to reiterate this call three years later?<\/p>\n

Summits and safety institutes<\/p>\n

The Bletchley summit was the first in a series of AI summits, held in subsequent years in Seoul, Paris and New Delhi. These summits led to the creation of a network of ten AI safety institutes across the globe \u2013 though some have since renamed themselves (in the UK to the AI Security Institute, and in the US to the Center for AI Standards and Innovation). <\/p>\n

Arguably the most successful of these institutes is the UK\u2019s, which has been backed by 66 million pounds per year in funding<\/a>, priority access to billions of dollars\u2019 worth of computing power, and advance access to the latest frontier AI models for safety testing. By contrast, Australia\u2019s AI Safety Institute was announced more than two years after the Bletchley Declaration and has around one-sixteenth the funding of its UK counterpart.<\/p>\n

As former director of the digital research branch of CSIRO, Australia\u2019s national science agency, I worked directly with many of the global AI safety institutes. Good work is going on, but many of the global institutes suffer from a lack of funding compared to the deep pockets of tech companies \u2013 they are like a bee on a bear. <\/p>\n

What can make AI safety agreements work?<\/p>\n

AI safety declarations \u2013 whether led by government or industry, nationally or globally \u2013 are critically important. Even if their direct outputs can sometimes seem underwhelming, they play an important role in raising awareness and in galvanising leaders to take action. <\/p>\n

That said, they need four things to maximise their chances of success: real funding, standing institutional machinery, enforceable consequences and specific commitments.<\/p>\n

Real funding is necessary for any kind of work with the famously deep-pocketed AI companies. The UK safety institute, for example, has serious money and priority access to computing power, and has been able to do excellent work.<\/p>\n

Standing institutional machinery is what lets the work happen. Agreements with AI companies allowed the UK and US institutes to jointly evaluate Anthropic\u2019s Claude Sonnet 3.5<\/a> before it was released in 2024, for example.<\/p>\n

Enforceable consequences are needed to make safety declarations more than just lists of wishes. A 2025 study<\/a> found evidence that a collection of voluntary commitments on AI safety which the White House secured from 15 AI companies in 2023 were followed only 53% of the time.<\/p>\n

Specific commitments are what lead to real change. Broad declarations draw engagement but offer little in the way of action and enforcement. A sweeping statement<\/a> from the February Delhi summit drew 92 signatories including the US and China. By contrast, September\u2019s UN statement made specific calls for independent testing and incident reporting and only has around 30 signatories, with the US and China staying away.<\/p>\n

What world leaders want<\/p>\n

Even with all the right content, AI safety declarations are only as good as the motivations of the political leaders behind them. <\/p>\n

In February 2025, one month after Trump\u2019s second inauguration, I attended the Paris AI Summit. The mood among international leaders had clearly shifted. <\/p>\n

The summits had started under then UK prime minister Rishi Sunak in 2023 as a genuine attempt to make AI safe. Very quickly, they headed in the opposite direction. Almost at once, global leaders began to focus on the growth opportunities from AI while downplaying the risks. <\/p>\n

As long as key world leaders continue to palm AI safety off onto self-regulation by tech companies, declarations will remain statements of intent \u2013 while the technology itself continues to rush ahead.<\/p>\n","protected":false},"excerpt":{"rendered":"Earlier this week, United States president Donald Trump and representatives of six of the world\u2019s most powerful tech…\n","protected":false},"author":2,"featured_media":914596,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-914595","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/914595","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=914595"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/914595\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/914596"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=914595"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=914595"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=914595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}