{"id":902677,"date":"2026-09-23T15:58:09","date_gmt":"2026-09-23T15:58:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/902677\/"},"modified":"2026-09-23T15:58:09","modified_gmt":"2026-09-23T15:58:09","slug":"as-ai-leaders-warn-of-catastrophe-us-and-china-shun-slowdown-calls-technology","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/902677\/","title":{"rendered":"As AI leaders warn of catastrophe, US and China shun slowdown calls | Technology"},"content":{"rendered":"<p>As industry leaders urge a global slowdown in artificial intelligence development for the sake of humanity, the two superpowers driving the technology\u2019s rapid advancement have given no indication they intend to hit the brakes.<\/p>\n<p>The United States and China, which are locked in a fierce strategic rivalry, have each rebutted calls to slow the pace of AI development, even as industry executives and researchers stress the need for international cooperation to avoid exposing humans to catastrophic \u2013 or even existential \u2013 risks.<\/p>\n<p>Recommended Stories list of 4 itemsend of list<\/p>\n<p>As US President Donald Trump and Chinese President Xi Jinping prepare to meet on Wednesday in Washington, DC, for the third time this year, expectations for cooperation on AI safety are modest. Observers anticipated measures that, at best, would fall far short of the coordinated slowdown that many experts said is needed.<\/p>\n<p>\u201cThe two countries host nearly all frontier labs and most of the models people download,\u201d said Alvin Wang Graylin, a senior fellow at the Asia Society Policy Institute\u2019s Center for China Analysis, describing agreed guardrails between the US and China as \u201cclose to a precondition\u201d for safe AI.<\/p>\n<p>\u201cA safety regime covering one side\u2019s models covers half the problem,\u201d Wang Graylin said.<\/p>\n<p>Hampering the prospects for US-China cooperation, analysts said, are mutual mistrust and divergent perceptions of the primary risks involved.<\/p>\n<p>Trump has dismissed fears about AI as a \u201cconspiracy\u201d and suggested guardrails are not needed under his leadership, stressing the need for\u00a0the US to stay ahead of China in the frontier technology.<\/p>\n<p>Trump, who has cast AI dominance as crucial to the US maintaining its position as the top global power, on Tuesday again poured cold water on hopes for international cooperation, telling the United Nations General Assembly that Washington would oppose any \u201cglobalist scheme\u201d to control AI.<\/p>\n<p>China has taken a more hands-on approach to AI regulation \u2013 releasing the third iteration of its security framework this month \u2013 but has similarly rebuffed calls for a slowdown, dismissing fears of existential risks aired in Silicon Valley as \u201cfearmongering\u201d.<\/p>\n<p>While Chinese officials have raised concerns about the dangers of AI, they have related it to more prosaic concerns, including cybersecurity and the authority of the ruling Communist Party.<\/p>\n<p>In a rare essay this month, Chinese Minister of State Security Chen Yixin warned of \u201chostile forces\u201d using AI to \u201cfabricate political rumours\u201d and \u201cincite antagonistic sentiments\u201d, threatening \u201cpolitical security, institutional security and ideological security\u201d.<\/p>\n<p>\u201cChina also increasingly recognises loss of control, misuse and cyber-risks but is much more sensitive to the possibility that \u2018AI safety\u2019 could become a justification for restricting Chinese access to chips, computers or markets,\u201d said Sun Chenghao, a fellow at the Center for International Security and Strategy at Tsinghua University in Beijing.<\/p>\n<p>\u201cSo the deepest obstacle is whether both sides can separate genuine safety cooperation from the wider technology competition,\u201d Sun said.<\/p>\n<p>\u201cIf every safety discussion is linked to export controls or slowing China\u2019s development, Beijing will naturally question the purpose of cooperation,\u201d Sun added.<\/p>\n<p>So far, the only proposals publicly floated by\u00a0either side have been a US-China dialogue and a <a href=\"https:\/\/www.aljazeera.com\/news\/2026\/9\/21\/whats-the-us-china-ai-hotline-that-trump-plans-to-pitch-to-xi\" rel=\"nofollow noopener\" target=\"_blank\">notification mechanism<\/a> for reporting national security threats.<\/p>\n<p>While those measures would be positive first steps, the US and China would still need to reach an agreement on the AI capabilities or uses that should be off-limits to avert the greatest threats, experts said.<\/p>\n<p>There is no consensus within the AI sector about how the technology should be regulated \u2013 or even whether government-led supervision is needed at all.<\/p>\n<p>While AI leaders such as Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman have called for a slowdown and greater regulation, some experts argued that such calls do not go far enough and development should be paused outright.<\/p>\n<p>\u201cInternational coordination is absolutely critical. We need more than safeguards,\u201d said David Krueger, an assistant professor at the University of Montreal who specialises in AI safety.<\/p>\n<p>\u201cWe need an immediate, indefinite international moratorium on frontier AI development.\u201d<\/p>\n<p>Other key figures, including Nvidia CEO Jensen Huang and Meta CEO Mark Zuckerberg, have played down the need for external oversight and emphasised AI\u2019s potential to deliver transformative benefits for society.<\/p>\n<p>Among those most alarmed at the rapid pace of AI development, recursive self-improvement, which describes when AI models learn to improve themselves, is often identified as a critical tipping point.<\/p>\n<p>In an essay this month urging the AI sector to \u201cpace the frontier\u201d, Amodei said the US and China should discuss an agreement to \u201csubstantially limit\u201d the rate of AI development while acknowledging that any deal is unlikely given the potential for a rule-breaking party to shift the global balance of power.<\/p>\n<p>\u201cThe US and China must agree on AI capabilities red lines that will not be crossed. Most crucially, AI must never get powerful enough for recursive self-improvement,\u201d said Otto Barten, director of the Netherlands-based Existential Risk Observatory.<\/p>\n<p>\u201cWe do not know where the positive feedback loop of ever-smarter AIs creating ever-smarter AIs without human supervision will end and what these agents will finally be able to do,\u201d Barten added.<\/p>\n<p>Wang Graylin said Washington and Beijing should come to an agreement on what constitutes an \u201cunacceptable capability\u201d and a common standard to test frontier models, ideally by an independent international body that is funded by multiple countries.<\/p>\n<p>But Wang Graylin acknowledged that distrust is clouding the prospects for an agreement and US officials are likely to see any deal as impossible to verify.<\/p>\n<p>\u201cVerification is hard for software you cannot see,\u201d he said.<\/p>\n<p>Sun said the US could ease the path to cooperation by \u201cdrawing a clearer line\u201d between policies aimed at AI safety and those intended to maintain Washington\u2019s technological advantage.<\/p>\n<p>China could also contribute to greater trust by providing \u201cgreater transparency about its safety practices, model-evaluation methods and incident-reporting mechanisms,\u201d Sun said.<\/p>\n<p>Henry Gao, an expert on China and trade law at Singapore Management University, said a deeper issue is a fundamental mismatch in how Washington and Beijing view AI risks.<\/p>\n<p>\u201cMany in the US AI-safety debate focus on the possibility of highly capable AI escaping human control and posing catastrophic risks to humanity,\u201d Gao said.<\/p>\n<p>\u201cIn China, national security concerns appear more geopolitical: A major perceived danger is that the US could gain a decisive AI advantage and use it against China,\u201d Gao said.<\/p>\n<p>\u201cThat creates pressure to accelerate rather than slow development.\u201d<\/p>\n<p>Some AI experts argued that the focus of a US-China dialogue should be on mitigating existing risks rather than slowing development outright.<\/p>\n<p>\u201cAI is already extremely useful and has the potential to improve lives around the world,\u201d said Rui Ma, a tech industry consultant and the founder of the Tech Buzz China news site, adding that pausing development would also impact the technology\u2019s positive applications.<\/p>\n<p>\u201cI think thoughtful rules of engagement, constant monitoring, open channels of communication and the ability to adjust our approach as AI acquires different capabilities are much more important,\u201d Ma said.<\/p>\n<p>\u201cThe safeguards need to evolve alongside the technology.\u201d<\/p>\n<p>Calling the upcoming talks between Trump and Xi a \u201cpositive signal\u201d, Jiang Tianjiao, associate professor at the Development Institute at Fudan University in Shanghai, expressed hope the sides could overcome their geopolitical rivalry to find common ground.<\/p>\n<p>\u201cChina and the US are currently the leading nations in AI development,\u201d Jiang said.\u00a0\u201cAs such, we bear the responsibility of major powers to prevent AI from spiralling out of control, and we should set a global example by cooperating to manage these risks.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"As industry leaders urge a global slowdown in artificial intelligence development for the sake of humanity, the two&hellip;\n","protected":false},"author":2,"featured_media":902678,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,77,64,63,6073,512,164,105,1055,6075],"class_list":["post-902677","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-asia-pacific","tag-au","tag-australia","tag-business-and-economy","tag-china","tag-economy","tag-technology","tag-united-states","tag-us-canada"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/902677","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=902677"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/902677\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/902678"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=902677"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=902677"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=902677"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}