Last month, a 27-year-old researcher named Jacob Coxon resigned from Anthropic with a stark warning that the leading AI labs, including OpenAI, where he previously worked, were \u201cgambling with our lives\u201d by racing towards developing ever more powerful models.<\/p>\n
The three researchers fired by OpenAI are Jasmine Wang, Tomek Korbak and Mikita Balesni, according to the WSJ. The researchers did not immediately respond to AFP\u2019s request for comment.<\/p>\n
All three have regularly posted about AI safety-related issues on X in recent weeks.<\/p>\n
\u201ci am at OpenAI and i think AI is >10% likely to kill all humans,\u201d Balesni posted on September 10, echoing statements made by other AI employees in recent weeks.<\/p>\n
As speculation swirled about why employees at OpenAI and Anthropic were speaking so freely about their personal beliefs, Korbak jumped into the public discourse.<\/p>\n
\u201cI\u2019m quite unhappy with much of what OpenAI does. I am very happy that Im allowed to say \u2018I\u2019m quite unhappy with much of what OpenAI does,\u2019\u201d Korbak wrote on September 11.<\/p>\n
\u201cIt\u2019s hard to overstate how dangerous speeding towards RSI is,\u201d Wang posted in response to Coxon\u2019s resignation, referring to recursive self-improvement, which is a technique where software is designed to continuously teach itself.<\/p>\n
Leading US tech companies signed a voluntary pledge this week to regulate themselves on safety after meeting with US President Donald Trump at the White House.<\/p>\n
Trump called it a \u201cmorally binding\u201d commitment to build adequate safeguards on the fast-moving technology.<\/p>\n
Executives from Nvidia, Google, Meta, xAI, OpenAI and Anthropic signed the agreement.<\/p>\n
Safety concerns<\/p>\n
Concerns about the safety of advanced AI models have escalated in recent months.<\/p>\n
OpenAI cancelled the release of a new model, Astra 6.1, because it deemed the model unreliable and found that it frequently ignored instructions.<\/p>\n
Instead, the company launched GPT-6.1 Sol, an updated version of a different model, during its annual DevDay conference from San Francisco. OpenAI said Sol would cost one-fifth the price of Astra.<\/p>\n
In July, AI agents developed by OpenAI attacked Hugging Face, an AI model and application library, during an incident where the autonomous software escaped its confined testing environment.<\/p>\n
Since then, additional security incidents have been reported that involved models developed by OpenAI, Anthropic and Google.<\/p>\n
Cybersecurity firm Asymmetric Security said in a report that agents developed by OpenAI covered up their own tracks after gaining unauthorised access to government websites.<\/p>\n
The Federal Trade Commission launched a broad investigation into artificial intelligence safety practices at Anthropic and OpenAI, the Washington Post has reported, though the scope of the inquiry is unclear.<\/p>\n
– AFP<\/p>\n","protected":false},"excerpt":{"rendered":"Last month, a 27-year-old researcher named Jacob Coxon resigned from Anthropic with a stark warning that the leading…\n","protected":false},"author":2,"featured_media":618341,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,7818,9556,363,364,264895,1656,304460,51592,26663,2082,8454,117715,15415,9557,2205,237570,5289,111,139,69,620,4989,10269,2214,3048,312,18155,145020,145,1361,1529,50638,4576],"class_list":["post-618340","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-allegedly","tag-artificial","tag-artificial-intelligence","tag-artificialintelligence","tag-chatgptmaker","tag-company","tag-evaluates","tag-external","tag-fired","tag-for","tag-including","tag-info","tag-information","tag-intelligence","tag-involved","tag-mishandling","tag-models","tag-new-zealand","tag-newzealand","tag-nz","tag-openai","tag-organisation","tag-policies","tag-researchers","tag-said","tag-says","tag-sensitive","tag-staffers","tag-technology","tag-that","tag-three","tag-violating","tag-work"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/618340","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=618340"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/618340\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/618341"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=618340"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=618340"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=618340"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}