\n The race to develop artificial intelligence is in dire need of a slowdown, Anthropic\u2019s chief executive said in an essay posted early Saturday.\n <\/p>\n
\n \u201cWe must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain,\u201d CEO Dario Amodei wrote in the 3,800-word post<\/a> to his website.\n <\/p>\n \n Amodei, who heads one of the world\u2019s leading AI companies and its chatbot Claude, has been a strong proponent for the technology\u2019s advancement \u2014 and similarly been accused of \u201cdoomerism\u201d in his warnings about AI\u2019s risks. He acknowledged Saturday that people may lose control of AI, and the technology can be misused for \u201ccyberattacks and bioterrorism<\/a>, and serious economic disruption<\/a>.\u201d\n <\/p>\n \n \u201cA race to the bottom, spurred by commercial incentives, can make these risks more acute,\u201d Amodei wrote.\n <\/p>\n \n Amodei\u2019s essay comes on the heels of an Anthropic researcher\u2019s resignation over concerns that the firm and its competitors are not acting responsibly with AI development.\n <\/p>\n \n \u201cThe people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt,\u201d the researcher, Jacob Coxon, posted Tuesday on X. \u201cIf anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately. No other human activity poses this level of danger.\u201d\n <\/p>\n \n In his essay, Amodei doesn\u2019t go as far as Coxon, but says the risks are serious even if the benefits could change humanity for the better. AI could advance so quickly that such a swarm could be capable of taking over the entire internet within six to 12 months, he wrote, potentially causing hundreds of billions of dollars in damages.\n <\/p>\n \n AI<\/a> technology, he said, has advanced \u201cdrastically faster\u201d in recent months and has become capable of making itself better, a dynamic known as \u201crecursive self-improvement.\u201d\n <\/p>\n \n \u201cLeft unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all,\u201d he wrote.\n <\/p>\n \n Amodei said the behavior of a swarm of AI agents in the OpenAI-Hugging Face<\/a> incident also alarmed him. The swarm, he said, \u201cessentially acted as a fanatically devoted collective<\/a>, conducting cybersecurity attacks on targets they were not asked to attack.\u201d\n <\/p>\n \n Coxon put it more bluntly.\n <\/p>\n \n \u201cThere is a very real possibility that in the immediate future, next year, the year after, recursive self-improvement will happen \u2026 where there\u2019s a chance that we could all die. That is coming soon,\u201d Coxon told CNN\u2019s Anderson Cooper<\/a> on Wednesday.\n <\/p>\n \n Amodei called on AI companies to impose guardrails for \u201cpacing the frontier.\u201d He suggested AI companies commit to hiring embedded third-party evaluators with full-company access \u2014 which he said \u201cAnthropic is unilaterally committing\u201d \u2014 to verify each firm\u2019s safety practices, report incidents and check AI models, training pipelines and processes.\n <\/p>\n \n Governments, both democratic and not, should coordinate \u201cto establish common safety standards,\u201d he added.\n <\/p>\n \n \u201cThe measures I propose to advance the frontier at a safe pace will not be easy. But I believe we owe it to humanity to try,\u201d he wrote.\n <\/p>\n \n The AI industry has long been concerned about the pace of the technology\u2019s advancement. Executives have urged governments to act to regulate the technology and cooperate to set worldwide safety standards. On Saturday, Elon Musk, whose AI company xAI powers the chatbot Grok, posted \u201cDario is right\u201d on X.\n <\/p>\n \n Washington has failed to keep pace with AI\u2019s steady march. Congress has debated but passed no overall AI-regulation legislation. And the White House hasn\u2019t been able to reach consensus on who within the executive branch is ultimately responsible for overseeing the technology, CNN has previously reported<\/a>.\n <\/p>\n \n Following the Hugging Face incident, OpenAI CEO Sam Altman suggested it may be time to slow down AI development. Pacing AI would \u201cgive ourselves enough time for society to harden around these new capability levels,\u201d he said on a July episode of the Invest Like The Best<\/a> podcast\n <\/p>\n \n In July, more than 1,300 top staffers at major tech companies signed an open letter<\/a> asking the US government to create tools to help slow the pace of AI development<\/a>, with support from Amodei and Altman.\n <\/p>\n \n This story has been updated with additional content.\n <\/p>\n","protected":false},"excerpt":{"rendered":"The race to develop artificial intelligence is in dire need of a slowdown, Anthropic\u2019s chief executive said in…\n","protected":false},"author":2,"featured_media":622608,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,61,60,80],"class_list":["post-622607","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ie","tag-ireland","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/622607","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=622607"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/622607\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/622608"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=622607"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=622607"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=622607"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}