{"id":716516,"date":"2026-06-05T08:09:14","date_gmt":"2026-06-05T08:09:14","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/716516\/"},"modified":"2026-06-05T08:09:14","modified_gmt":"2026-06-05T08:09:14","slug":"anthropic-urges-global-freeze-on-ai-calls-on-rivals-to-join","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/716516\/","title":{"rendered":"Anthropic urges global freeze on AI, calls on rivals to join"},"content":{"rendered":"

\"DavidSave<\/p>\n

You have reached your maximum number of saved items.<\/p>\n

Remove items from your saved list<\/a> to add more.<\/p>\n

AAA<\/p>\n

The world\u2019s most valuable artificial intelligence company has called for a global freeze on the development of the most powerful AI systems, warning that humanity is approaching a point where it could lose control of the technology it is racing to build.<\/p>\n

In a blog post<\/a> published on Thursday (Friday AEST), Anthropic, the San Francisco company behind the Claude chatbot, said it would be willing to suspend work on more capable systems if it could be confident that its rivals would do the same.<\/p>\n

\u201cIf it were possible to effectively slow the development of this technology to give ourselves more time to deal with its immense implications, we think that would likely be a good thing,\u201d executives wrote.<\/p>\n

\"Anthropic\u2019sAnthropic\u2019s Claude Mythos Preview has been too powerful to release to the general public.Bloomberg<\/p>\n

Anthropic has every commercial reason to keep building. It recently overtook ChatGPT maker OpenAI to become the world\u2019s most valuable AI firm, at a valuation of about $US965 billion ($1.3 trillion). It has also withheld its most powerful system, known as Mythos, from public release over fears it could be used to carry out devastating cyberattacks, and it said this week it would extend access to Mythos to Australian organisations<\/a> for the first time, as part of a staggered rollout meant to fix security flaws before the product reaches hackers.<\/p>\n

The Albanese government welcomed the intervention. Andrew Charlton, the assistant minister for science and technology, who is leading Labor\u2019s AI strategy, said the pace of progress \u201cmust not outstrip understanding or undermine safety across society, and no company should develop AI that is unsafe\u201d.<\/p>\n

\u201cThe government welcomes calls for a more considered approach to frontier AI development,\u201d Charlton said. \u201cLabor believes technology should work for people and their benefit.\u201d<\/p>\n

Anthropic\u2019s argument turns on a concept it calls \u201crecursive self-improvement\u201d: the point at which AI systems become capable of designing and building their own successors with little human input. Anthropic head of research Marina Favaro and its president Jack Clark said the industry was edging towards that threshold, and that crossing it could trigger an explosion in capabilities that outpaces society\u2019s ability to manage the consequences.<\/p>\n

\"AnthropicAnthropic chief executive Dario Amodei has called for regulation of the technology.Bloomberg<\/p>\n

To make the case, the company published internal data on how quickly Claude is improving, and it said more than 80 per cent of new code had been written by Claude rather than by humans. In one instance, the company said Claude had resolved more than 800 software bugs in April that it estimated would have taken a human engineer four years to fix.<\/p>\n

Favaro and Clark called the situation an \u201carms control problem\u201d. They said there was limited time to act. They were also candid about how difficult a co-ordinated slowdown would be in practice.<\/p>\n

\u201cA meaningful slowdown or pause would require multiple well-resourced labs at or near the frontier, in multiple countries, agreeing to stop under the same conditions,\u201d they wrote. \u201cIt would also require that each can verify that the others have actually stopped \u2026 Training runs are far easier to conceal than missile silos.\u201d<\/p>\n

The company said a freeze could also backfire. \u201cIf a slowdown simply lets the least cautious actors catch up technologically, it could leave everyone less safe,\u201d it wrote, a reference to the competition between the United States and China, where neither government has shown any appetite to ease off.<\/p>\n

Related Article\"Anthropic<\/a><\/p>\n

The industry remains split over how close today\u2019s systems are to milestones such as recursive self-improvement and artificial general intelligence, a level of machine intelligence broadly comparable to a human\u2019s. Some researchers say such talk overstates what current models can do and distracts from the harms AI is already causing, including discrimination, scams and privacy breaches.<\/p>\n

Anthropic has positioned itself as the most safety-conscious of the major labs, even as it releases the breakthroughs it says could prove dangerous. Chief executive Dario Amodei, who left OpenAI over safety and ethics concerns, has said there is a 25 per cent chance that \u201cthings go really, really badly\u201d with the technology.<\/p>\n

\"LaborLabor MP Ed Husic.Alex Ellinghausen<\/p>\n

In Australia, the federal government\u2019s long-delayed AI Safety Institute is expected to open within months. Last week, the institute signed a memorandum of understanding with Britain\u2019s AI Security Institute covering shared research and the testing of emerging systems. The British body was among the first to publicly evaluate an earlier version of Anthropic\u2019s Mythos model.<\/p>\n

Anthropic\u2019s call for restraint runs against the direction the federal government has taken at home. In December, it shelved plans for mandatory guardrails on high-risk AI, including the standalone, EU-style AI Act that former industry minister Ed Husic had championed, in favour of a lighter-touch model that leans on existing laws and regulators. Husic, who was dropped from the ministry last year, had said a piecemeal approach would leave dangerous gaps.<\/p>\n

Polling suggests the public is wary about AI. A recent global survey of 23 countries from EY found Australians were among the heaviest users of AI but that they held the equal-worst sentiment towards it: 68 per cent were worried about losing control over decisions the technology makes on their behalf.<\/p>\n

Not everyone thinks the call should rest with the companies. PauseAI Australia, part of an international movement pushing to halt frontier AI development, welcomed Anthropic\u2019s intervention but it said the terms of any freeze should not be set by industry.<\/p>\n

\u201cPauseAI Australia welcomes Anthropic\u2019s acknowledgement that a global pause button is required,\u201d a volunteer for the group told this masthead. \u201cThey understand that the race to build superintelligence is incredibly dangerous. But it should not be left to AI companies to decide how AI development is regulated.\u201d<\/p>\n

Governments around the world, including Australia\u2019s, should \u201cbe coming together to negotiate a treaty to pause the further development of advanced AI until it can be done safely and under democratic control\u201d, the group said.<\/p>\n

with Paul Sakkal<\/p>\n

Get news and reviews on technology, gadgets and gaming in our Technology newsletter every Friday. Sign up here<\/a>.<\/p>\n

Save<\/p>\n

You have reached your maximum number of saved items.<\/p>\n

Remove items from your saved list<\/a> to add more.<\/p>\n

\"DavidDavid Swan<\/a> is the technology editor for The Age and The Sydney Morning Herald. He was previously technology editor for The Australian newspaper.Connect via X<\/a> or email<\/a>.From our partners<\/p>\n","protected":false},"excerpt":{"rendered":"Save You have reached your maximum number of saved items. Remove items from your saved list to add…\n","protected":false},"author":2,"featured_media":716517,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-716516","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/716516","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=716516"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/716516\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/716517"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=716516"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=716516"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=716516"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}