{"id":845483,"date":"2026-09-12T17:26:10","date_gmt":"2026-09-12T17:26:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/845483\/"},"modified":"2026-09-12T17:26:10","modified_gmt":"2026-09-12T17:26:10","slug":"anthropic-ceo-calls-for-slowing-the-ai-race-as-safety-warnings-mount","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/845483\/","title":{"rendered":"Anthropic CEO calls for slowing the AI race as safety warnings mount"},"content":{"rendered":"<p id=\"anchor-d4e1f1\" class=\"body-graf\">The CEO of one of the world\u2019s leading AI companies is calling for the industry to slow the development of increasingly powerful AI systems, continuing this week\u2019s <a href=\"https:\/\/www.nbcnews.com\/tech\/tech-news\/anthropic-safety-researcher-resigned-warning-rapid-ai-development-gamb-rcna596767\" target=\"_blank\" rel=\"nofollow noopener\">cascade of warnings<\/a> from researchers <a href=\"https:\/\/www.nbcnews.com\/tech\/security\/two-ai-researchers-leave-anthropic-google-safety-concerns-rcna597086\" target=\"_blank\" rel=\"nofollow noopener\">working on the technology.<\/a><\/p>\n<p id=\"anchor-987b97\" class=\"body-graf\">Dario Amodei, the CEO of Anthropic, said in essay published Saturday that AI companies should deliberately \u201cslow the pace\u201d at which they improve their models, arguing that AI advances are moving faster than researchers\u2019 ability to understand and control them.<\/p>\n<p id=\"anchor-b609f4\" class=\"body-graf\">\u201cWe must slow the pace at which we improve the capabilities of AI models,\u201d Amodei wrote in the <a href=\"https:\/\/darioamodei.com\/post\/we-must-pace-the-frontier\" target=\"_blank\" rel=\"nofollow noopener\">nearly 4,000-word essay<\/a>. Progress will still seem fast, he note, and we must make wise use of the time we gain. <\/p>\n<p id=\"anchor-da740c\" class=\"body-graf\">Amodei pointed to two developments that he said had changed his thinking: the increasing ability of AI systems to build more advanced AI, and a July incident in which autonomous AI agents powered by an OpenAI model hacked systems belonging to the <a href=\"https:\/\/www.nbcnews.com\/tech\/tech-news\/openai-report-says-network-was-hacked-rogue-ai-agents-rcna594590\" target=\"_blank\" rel=\"nofollow noopener\">AI company Hugging Face<\/a>. <\/p>\n<p id=\"anchor-be11f7\" class=\"body-graf\">\u201cIt\u2019s easy to dismiss this incident because no one was hurt and the economic damage was minimal, but in my opinion, a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage,\u201d he wrote.<\/p>\n<p id=\"anchor-de7aa1\" class=\"body-graf\">Anthropic, the maker of the Claude chatbot, is itself one of the companies competing to build increasingly powerful AI systems. Amodei\u2019s call comes after a series of public warnings from researchers at Anthropic, OpenAI and Google about the risks of the race they are helping to fuel.<\/p>\n<p id=\"anchor-4c7b50\" class=\"body-graf\"><a href=\"https:\/\/www.nbcnews.com\/tech\/tech-news\/anthropic-safety-researcher-resigned-warning-rapid-ai-development-gamb-rcna596767\" target=\"_blank\" rel=\"nofollow noopener\">Jacob Coxon, an Anthropic safety researcher who resigned this week<\/a>, told colleagues in a message obtained by NBC News that he believed the industry\u2019s approach to developing superintelligent AI amounted to a \u201cgamble with our lives.\u201d<\/p>\n<p id=\"anchor-4bfe02\" class=\"body-graf\">\u201cFrom within, you\u2019re just stuck in the race,\u201d Coxon later told NBC News, describing the competitive pressures on AI companies. \u201cYou can\u2019t change the overall structural dynamics of the situation.\u201d<\/p>\n<p id=\"anchor-439d1a\" class=\"body-graf\">\u201cPrivate companies in a race don\u2019t allow these people to end up doing good, and we could just sleepwalk into disaster,\u201d he said.<\/p>\n<p id=\"anchor-401fa9\" class=\"body-graf\"><a href=\"https:\/\/www.nbcnews.com\/tech\/security\/two-ai-researchers-leave-anthropic-google-safety-concerns-rcna597086\" target=\"_blank\" rel=\"nofollow noopener\">Two other researchers <\/a>who recently left Anthropic and Google DeepMind told NBC News they had similar concerns.<\/p>\n<p id=\"anchor-4889ef\" class=\"body-graf\">Joe Benton, who used to lead a safety research team at Anthropic, warned that advances in AI could push development from its already \u201cblistering\u201d pace to an \u201cuncontrollable\u201d one. Josh Engels, a former Google safety researcher, offered an even starker warning.<\/p>\n<p id=\"anchor-f066c5\" class=\"body-graf\">\u201cThere are no adults in the room,\u201d Engels  said. \u201cPeople are trying their best, but there is no one coming to save us.\u201d<\/p>\n<p id=\"anchor-c29259\" class=\"body-graf\">Amodei is proposing what he calls \u201cpacing the frontier,\u201d a three-part plan that he said would buy researchers more time without halting AI development.<\/p>\n<p id=\"anchor-b6d2c8\" class=\"body-graf\">He said Anthropic would begin embedding independent evaluators inside the company, giving them access to models, internal tools and researchers to assess risks. Amodei called for similar oversight across leading U.S. AI companies, backed by federal regulation and eventually for international coordination.<\/p>\n<p id=\"anchor-504521\" class=\"body-graf\">OpenAI CEO Sam Altman quickly endorsed the proposal, saying that his company would also give independent evaluators access.<\/p>\n<p id=\"anchor-d8e0c9\" class=\"body-graf\">The goal is not to stop AI progress, Amodei wrote, but to give researchers time to develop safeguards, better understand how increasingly capable systems work and test whether they can be reliable controlled.<\/p>\n<p id=\"anchor-831e2d\" class=\"body-graf\">He estimated that slowing development could buy researchers one or two more years, time he argued could prove critical as AI systems become increasingly capable of contributing to their own development.<\/p>\n<p id=\"anchor-eacd09\" class=\"endmark body-graf\">\u201cThe stakes are too high for pacing to be an empty exercise \u2014 we need to use the time it gives us wisely,\u201d he wrote.<\/p>\n","protected":false},"excerpt":{"rendered":"The CEO of one of the world\u2019s leading AI companies is calling for the industry to slow the&hellip;\n","protected":false},"author":2,"featured_media":845484,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[4,450,451,3,452,453],"class_list":["post-845483","post","type-post","status-publish","format-standard","has-post-thumbnail","category-breaking-news","tag-breaking-news","tag-breakingnews","tag-headlines","tag-news","tag-top-stories","tag-topstories"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/845483","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=845483"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/845483\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/845484"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=845483"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=845483"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=845483"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}