{"id":600160,"date":"2026-08-21T12:18:09","date_gmt":"2026-08-21T12:18:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/600160\/"},"modified":"2026-08-21T12:18:09","modified_gmt":"2026-08-21T12:18:09","slug":"i-worked-at-openai-heres-how-tech-companies-can-prepare-for-a-slowdown-miles-brundage","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/600160\/","title":{"rendered":"I worked at OpenAI. Here\u2019s how tech companies can prepare for a slowdown | Miles Brundage"},"content":{"rendered":"

Last month, more than a thousand employees at frontier AI companies signed a letter<\/a> asking the US government to find a way to \u201cpace\u201d AI development, citing the risk of the technology spiraling out of human control as it begins to build itself<\/a>.<\/p>\n

They were right to be concerned: just days earlier, two AI models that OpenAI was testing internally escaped the test environment, then autonomously hacked the company Hugging Face and at least three other online services<\/a>. A few days after that, Anthropic announced<\/a> that some of their models had also broken out and hacked other companies during testing.<\/p>\n

Against that backdrop, the letter\u2019s recommendation to install brakes in case they\u2019re needed at the frontier of automated AI development makes sense. But the rationale the letter gives for why the government needs to step in is notable: \u201cEach company\u2014and country\u2014is under intense competitive pressure not to unilaterally slow that acceleration.\u201d<\/p>\n

I know \u2013 from my own experience and from countless conversations with former colleagues in the AI industry \u2013 how real these pressures are. While working at OpenAI, I helped establish the practice<\/a> of companies writing \u201csystem cards<\/a>\u201d that describe AI systems\u2019 capabilities, risks and safety mitigations in detail.<\/p>\n

So what would it look like for companies to prepare for a possible slowdown?<\/p>\n

First, they could voluntarily invite rigorous, independent auditing<\/a> of their safety and security practices. This would go beyond the vetting of AI hacking abilities that the White House is now pursuing. It would look at a range of risks and dig deep into company practices. It should be less like filling out a questionnaire and more like a nuclear safety inspector who has deep, frequent access to the company.<\/p>\n

If an AI slowdown is needed, auditing would also reassure each company that their competitors are playing by the rules.<\/p>\n

Second, they could actively participate in the organizations already built for this purpose of coordinating across the industry, such as the Frontier Model Forum<\/a>, and move quickly to establish complementary ones.<\/p>\n

Elon Musk recently said<\/a> that AI companies should meet periodically to share notes on safety \u2013 as if this was an unheard-of concept. He or his staff could join existing conversations along these lines tomorrow if SpaceX joined the Frontier Model Forum, which has already worked through the complex antitrust hurdles involved in safety information sharing. Other cross-industry institutions will be needed for other purposes, and do not require government action to get founded and funded.<\/p>\n

Third, they could invest in the technologies we need to make AI guardrails global.<\/p>\n

Critics of the idea of an AI slowdown correctly point out that American companies couldn\u2019t slow down for very long without China catching up. But neither the US nor China<\/a> wants to lose control over AI, and each country takes AI more and more seriously by the day, so cooperation can\u2019t yet be ruled out either. A key question is whether we prepare in advance. In order for the US to be highly confident that China couldn\u2019t violate an AI agreement, and vice versa, we\u2019ll need sophisticated verification technologies like those developed during the cold war for nuclear arms control.<\/p>\n

Fortunately, there is a growing ecosystem of researchers and engineers developing those<\/a> very<\/a> technologies<\/a>: tools that can prove a set of chips is only running existing AI systems rather than training new ones, that those chips are in a certain physical location, or that the system that got tested is the same one being deployed at scale. AI companies could accelerate the development of this critical type of technology today through funding and participation in pilot projects, but to my knowledge, they haven\u2019t yet done so.<\/p>\n

Fourth, they could proactively push \u2013 and certainly should not kill \u2013 legislation that leads to stronger incentives for safety, security, and external oversight.<\/p>\n

You can\u2019t complain about an irresponsible AI race while fighting commonsense guardrails. Less than a year ago, some of the same companies<\/a> who are asking for regulation now were pushing to overturn most state AI laws. We still have no real legislation on frontier AI on the books at a federal level, and the first AI auditing requirement at the state level won\u2019t kick in until 2028.<\/p>\n

There are promising bipartisan proposals in Congress right now, such as the Frontier Act from the US representatives Jay Obernolte and Lori Trahan, which would require developers of advanced AI systems to create a risk management framework, report dangerous incidents, and subject themselves to independent audits. These and other commonsense proposals, such as protecting AI whistleblowers<\/a> who disclose safety incidents directly to the government, deserve vigorous support.<\/p>\n

I agree with the signatories, and am glad that after many years of being ignored or downplayed, the risks of unbridled AI competition are widely recognized. The US government should be doing its part to address this, and swiftly. But making AI go well is a shared responsibility. Companies that lag behind their peers on safety, don\u2019t invite external audits of their systems, or call for brakes while doing little to build them won\u2019t be able to blame the AI race when something goes wrong.<\/p>\n

Miles Brundage is an AI policy researcher who leads the AI Verification and Evaluation Research Institute (Averi). He previously worked at OpenAI<\/a> as head of policy research and senior adviser for AGI Readiness<\/p>\n","protected":false},"excerpt":{"rendered":"Last month, more than a thousand employees at frontier AI companies signed a letter asking the US government…\n","protected":false},"author":2,"featured_media":600161,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,61,60,80],"class_list":["post-600160","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ie","tag-ireland","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/600160","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=600160"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/600160\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/600161"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=600160"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=600160"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=600160"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}