{"id":885528,"date":"2026-09-09T10:00:12","date_gmt":"2026-09-09T10:00:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/885528\/"},"modified":"2026-09-09T10:00:12","modified_gmt":"2026-09-09T10:00:12","slug":"anthropic-researcher-quits-saying-ai-developers-believe-it-could-kill-us-all","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/885528\/","title":{"rendered":"Anthropic researcher quits saying AI developers believe ‘it could kill us all’"},"content":{"rendered":"

Anthropic researcher Jacob Coxon has quit the AI company, saying those building the technology “earnestly believe that it could kill us all by the end of the decade”.<\/p>\n

Mr Coxon said he had spent the past three years doing pre-training research at Anthropic and OpenAI.<\/p>\n

“Neither company is acting responsibly,” he posted on X<\/a>.<\/p>\n

“They are racing straight to self-improving superintelligence and gambling with our lives.”<\/p>\n

Superintelligence is considered to be the stage of AI when machines surpass human performance in every field.<\/p>\n

Anthropic Alignment Science lead Evan Hubinger posted a reply on X saying Mr Coxon was correct.<\/p>\n

“We really do earnestly believe AI could kill all humans! I personally think it is >10 per cent within the next decade,” he wrote.<\/p>\n

“I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”<\/p>\n

Mr Coxon is one of a growing number of AI experts to call on the industry to slow down.<\/p>\n

In July more than 1,300 employees of frontier AI companies signed a statement saying there was a “real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems”.<\/p>\n

The letter called on the US government to support an international effort to develop tools that can “deliberately pace the frontier of automated AI development”.<\/p>\n

\"A<\/p>\n

CEO and co-founder of Anthropic, Dario Amodei. (Reuters: Denis Balibouse)<\/p>\n

Responding to the initiative, called Pacing the Frontier, Anthropic said in an X post: “Our own research on recursive self-improvement, published last month, points to the need for tools to deliberately pace the frontier of AI development \u2060so society can prepare”.<\/p>\n

OpenAI also responded to the letter, posting on X: “We believe that, at some point in the future, AI acceleration \u200cfor \u2060frontier model development may be so high that the world will need to pace the rate of AI advancement.”<\/p>\n

AI could pose ‘existential’ risk, UN warns<\/p>\n

The “alignment problem” for superintelligence is that an AI system may not share human values.<\/p>\n

Autonomous drones and AI called out by UN human rights chief<\/a><\/p>\n

UN-rights chief has addressed a council in Geneva saying AI posed a threat to humanity.\u00a0<\/p>\n

On Monday, United Nations rights chief Volker Turk also warned that artificial intelligence could pose a threat to humanity and pledged to press AI firms to reduce risks that his office said included disruptions to services, communications and democratic systems.<\/p>\n

He called for “cast-iron guarantees” to secure AI in a speech ahead of the start of his unprecedented second term.<\/p>\n

“I share the concerns of industry insiders that advanced AI could pose an existential risk to humanity,” Mr Turk told the body in Geneva.<\/p>\n

“I am calling here, today, for an all-out effort to put cast-iron guarantees in place around the safety and security of AI before it is too late.”<\/p>\n

\u00a0ABC\/Reuters<\/p>\n","protected":false},"excerpt":{"rendered":"Anthropic researcher Jacob Coxon has quit the AI company, saying those building the technology “earnestly believe that it…\n","protected":false},"author":2,"featured_media":885529,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[256,2729,254,64,63,99,455290,5044,394189,64791,118652],"class_list":["post-885528","post","type-post","status-publish","format-standard","has-post-thumbnail","category-business","tag-ai","tag-anthropic","tag-artificial-intelligence","tag-au","tag-australia","tag-business","tag-jacob-coxon","tag-openai","tag-skynet","tag-superintelligence","tag-terminator"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/885528","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=885528"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/885528\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/885529"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=885528"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=885528"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=885528"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}