{"id":716708,"date":"2026-06-05T11:49:10","date_gmt":"2026-06-05T11:49:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/716708\/"},"modified":"2026-06-05T11:49:10","modified_gmt":"2026-06-05T11:49:10","slug":"anthropic-calls-for-global-pause-in-ai-development-before-humans-lose-control","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/716708\/","title":{"rendered":"Anthropic calls for global pause in AI development before humans lose control"},"content":{"rendered":"

Anthropic PBC<\/a> has sounded the alarm on the rapid pace of artificial intelligence development and is calling on the world\u2019s top AI laboratories to consider slamming on the brakes.<\/p>\n

In a blog post today, the company warned<\/a> that AI systems are getting close to the point where they may soon be able to improve themselves without human oversight, and said reaching this threshold could lead to massive societal disruption.<\/p>\n

The startup\u2019s solution is for a globally coordinated agreement to temporarily pause or at least slow down the pace at which new frontier models are being developed. In the blog post, Anthropic\u2019s head of internal research Marina Favaro and head of policy Jack Clark argued that a pause would provide the world with the breathing room it needs to adjust to the pace of AI\u2019s rapid growth.<\/p>\n

The two authors said model advances appear to be getting closer to a theoretical concept known as \u201crecursive self-improvement,\u201d which refers to AI systems that are capable of independently improving themselves and expanding their own capabilities, simply by writing their own code. They acknowledge that this hasn\u2019t happened yet and isn\u2019t necessarily inevitable, but they also warn it could happen \u2013 much sooner than anyone is prepared for. According to Clark, there\u2019s reason to believe that some models could be capable of recursive self-improvement within just two years.<\/p>\n

\u201cWe believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology,\u201d the authors suggested.<\/p>\n

There are reasons to listen to Anthropic when it makes such a dire warning. The company recently concluded a massive, $65 billion funding round<\/a> that brought its valuation close to $1 trillion, and this week it filed paperwork<\/a> with the Securities and Exchange Commission stating its plans to list on the public market. It has emerged as one of the frontrunners in an intense competition for market supremacy with ChatGPT developer OpenAI Group PBC, which is also expected to launch an initial public offering soon.<\/p>\n

However, Anthropic, which has carefully cultivated an image of erring on the side of caution and advocating for public safety, has also been accused of leveraging policy to try to slow down the advances of its competitors. David Sacks, a venture capitalist and an informal adviser to U.S. President Donald Trump, has previously accused the company of running a \u201cregulatory capture agenda.\u201d He argues that the company uses fear-mongering in a calculated way to encourage heavy-handed regulations that would essentially ban lower-cost open-source models in order to boost the popularity of its own proprietary algorithms.<\/p>\n

Whether such a slowdown is even feasible is highly debatable. Enforcing a global pause on AI development would likely be near-impossible, Rob Enderle of the Enderle Group told SiliconANGLE. \u201cThis would be practically impossible, because the economic and national security stakes are simply too high for any superpower to willingly hit the brakes now,\u201d he said.<\/p>\n

Anthropic conceded that it would likely require something similar to the Cold War-era treaties that slowed down the pace of nuclear weapons proliferation, but noted that it\u2019s a lot easier to mask AI training runs than it is to conceal missile silos. Unless some kind of ironclad verification regime is put in place, with cooperation from countries such as China, any pause would risk creating a scenario where competing nations simply ignore the pause and take the lead in AI development.<\/p>\n

\u201cTracking decentralized computing resources, private data centers and algorithmic research globally is far more difficult than monitoring something physical, like nuclear facilities,\u201d Enderle added.<\/p>\n

The analyst said Anthropic\u2019s blog post is more about strategic marketing than any concrete initiative to actually rein in AI developers. \u201cThe productivity gains it\u2019s reporting are likely to be legitimate, but promoting its progress toward recursive self-improvement is a more calculated move,\u201d Enderle said. \u201cIt\u2019s hyping its capabilities to investors to position itself as the absolute bleeding-edge leader in the space, and subtly driving the narrative that its technology is so advanced it requires massive, ongoing funding to manage safely.\u201d<\/p>\n

Holger Mueller of Constellation Research said he was encouraged to see Anthropic asking itself important ethical and safety questions, but he too wondered what its motivations really are.\u00a0 \u201cIs it trying to freeze the status quo so it can catch up, or simply retain its lead?\u201d he asked. \u201cA freeze would certainly help Anthropic to maintain its leading position in B2B AI systems and perhaps even expand its market share.\u201d<\/p>\n

The analyst also said that the risk of AI using recursive learning to improve itself is only theoretical, and has never been shown to have occurred in the real world. \u201cMoreover, given the lack of AI training capacity at present, it won\u2019t be easy for AI to expand its own capabilities,\u201d he said. \u201cAI definitely needs some level of regulation, and it\u2019s better to have it sooner rather than later, but the difficult is to strike a balance that avoids causing harm without hindering progress.\u201d<\/p>\n

Regardless of their real motivations, the authors said they intend to push forward with their idea of holding back AI development. Anthropic Institute, which is the company\u2019s in-house research organization that\u2019s dedicated to understanding and shaping AI\u2019s impact on the world, will continue collaborating with others on ways to \u201chelp build systems that a credible slowdown or pause would require.\u201d<\/p>\n

The company said it will try to organize a broader debate with policymakers and AI researchers to try and answer questions about the likelihood of self-recursive improvement and what a verification system might look like. \u201cIn the absence of a coordinated, global slowdown, we are left with the current situation: powerful technology being developed at breakneck speed by a variety of actors in a variety of countries, locked in a competition with one another where commercial and geopolitical rivalries are drowning out the larger existential-to-the-species aspects of the technology being built,\u201d the authors wrote.<\/p>\n

Image: Anthropic<\/p>\n

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE\u2019s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.<\/p>\n

15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
\n11.4k+ theCUBE alumni \u2014 Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network.<\/p>\n

About SiliconANGLE Media<\/p>\n

SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE<\/a>, theCUBE Network<\/a>, theCUBE Research<\/a>, CUBE365<\/a>, theCUBE AI<\/a> and theCUBE SuperStudios \u2014 with flagship locations in Silicon Valley and the New York Stock Exchange \u2014 SiliconANGLE Media operates at the intersection of media, technology and AI.<\/p>\n

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.<\/p>\n","protected":false},"excerpt":{"rendered":"Anthropic PBC has sounded the alarm on the rapid pace of artificial intelligence development and is calling on…\n","protected":false},"author":2,"featured_media":716709,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[259538,45,49,48,21203,3680],"class_list":["post-716708","post","type-post","status-publish","format-standard","has-post-thumbnail","category-business","tag-anthropic-calls-for-global-pause-in-ai-development-before-humans-lose-control","tag-business","tag-ca","tag-canada","tag-mike-wheatley","tag-siliconangle"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/716708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=716708"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/716708\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/716709"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=716708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=716708"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=716708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}