{"id":870065,"date":"2026-10-04T03:28:12","date_gmt":"2026-10-04T03:28:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/870065\/"},"modified":"2026-10-04T03:28:12","modified_gmt":"2026-10-04T03:28:12","slug":"openai-safety-leader-quits-warning-ai-companys-culture-is-broken-openai","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/870065\/","title":{"rendered":"OpenAI safety leader quits, warning AI company\u2019s culture is \u2018broken\u2019 | OpenAI"},"content":{"rendered":"

A safety leader at OpenAI<\/a> has quit the company, warning that its culture was broken and that AI firms were not \u201cbeing nearly careful enough\u201d about developing the technology.<\/p>\n

David Robinson, who led the writing of safety reports that accompanied the ChatGPT developer\u2019s product releases, explained his resignation in an essay headlined, \u201cI quit OpenAI because its culture is broken\u201d.<\/p>\n

Robinson wrote that a cultural overhaul was needed at cutting-edge AI firms and incidents such as a \u201cswarm\u201d of OpenAI agents \u2013 AI programmes operating autonomously without human oversight \u2013 attacking the AI startup Hugging Face<\/a> were \u201ctypical of the industry, given the speed and flexibility with which people operate\u201d.<\/p>\n

Writing in The Atlantic magazine<\/a>, Robinson wrote: \u201cI agree with other recently departed staff that the companies building this technology aren\u2019t being nearly careful enough. But I believe that we need to look deeper than specific rules or new laws. We need to talk about culture.\u201d<\/p>\n

Referring to OpenAI\u2019s pace of development, he wrote: \u201cAs the company sprints from one launch to the next, it is failing to achieve the level of care that I believe is needed.\u201d<\/p>\n

OpenAI has, however, shown signs of caution in recent weeks following the Hugging Face incident and the revelation that it has notified more than 100 organisations about rogue agent activity. This week it announced it was scrapping the release of a next-generation \u2060AI model<\/a> after researchers raised safety concerns \u2060during internal testing. OpenAI has also paused training<\/a> of its most advanced models.<\/p>\n

Geoffrey Irving, who worked at OpenAI and DeepMind before becoming chief scientist of Resolution, also joined the warnings on AI on Saturday.<\/p>\n

Writing in Time, he said: \u201cRecent warnings about the potential destructive power of AI are understating the severity of the situation.<\/p>\n

\u201cI believe there\u2019s about a 50% chance we all die because of the development of smarter-than-human AI systems, and that our actions over the next two to 10 years will determine the outcome.\u201d<\/p>\n

Robinson\u2019s essay also follows the resignation of Jacob Coxon, a researcher at OpenAI rival Anthropic, who quit the Claude chatbot developer last month. He warned AI \u201ccould kill us all by the end of the decade\u201d \u2013 and was followed by Anthropic warning<\/a> there was a more than 10% chance AI would wipe out humanity within the next decade. Critics of such warnings have cautioned, however, that they are unscientific<\/a> because they cannot be verified or falsified.<\/p>\n

Robinson wrote Silicon Valley lacked an awareness of \u201chow to handle dangerous technology\u201d and \u201cwhat it means to care for people\u201d. Warning that OpenAI had \u201cunimpeded optimism\u201d about solving problems as they arose, he wrote that this internal culture meant safety failures would only grow as systems become more capable.<\/p>\n

\u201cImagine \u2018rogue\u2019 agents that work like teams of hackers (for example, holding hospital computer systems for ransom) but never need to sleep,\u201d wrote Robinson.<\/p>\n

skip past newsletter promotion<\/a><\/p>\n

Sign up to TechScape<\/p>\n

A weekly dive in to how technology is shaping our lives<\/p>\n

\"\"<\/p>\n

Robinson called for two safety changes: that AI firms rely on safety expertise in other fields such as nuclear and aviation and develop \u201cnew science\u201d that ensures powerful systems in the future are capable of being reined in when they are operating autonomously.<\/p>\n

\u201cGiven today\u2019s risks, frontier labs need to run like nuclear-power plants or busy airports, with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster,\u201d he wrote.<\/p>\n

An OpenAI spokesperson said the company was continuing to \u201cstrengthen our safety and security practices to address the risks we see today\u201d, while working on dealing with the risks that might be created by future AI breakthroughs.<\/p>\n

\u201cWe\u2019re making sure our models don\u2019t become more capable than we can safely manage and secure, and we pause training or hold back models when we need to slow down,\u201d said the spokesperson.<\/p>\n","protected":false},"excerpt":{"rendered":"A safety leader at OpenAI has quit the company, warning that its culture was broken and that AI…\n","protected":false},"author":2,"featured_media":870066,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,74],"class_list":["post-870065","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/870065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=870065"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/870065\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/870066"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=870065"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=870065"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=870065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}