{"id":444150,"date":"2026-02-25T04:12:08","date_gmt":"2026-02-25T04:12:08","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/444150\/"},"modified":"2026-02-25T04:12:08","modified_gmt":"2026-02-25T04:12:08","slug":"anthropic-drops-flagship-safety-pledge","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/444150\/","title":{"rendered":"Anthropic Drops Flagship Safety Pledge"},"content":{"rendered":"

Anthropic, the wildly successful AI company that has cast itself as the most safety-conscious of the top research labs, is dropping the central pledge of its flagship safety policy, company officials tell TIME.<\/p>\n

In 2023, Anthropic committed to never train an AI system unless it could guarantee in advance that the company\u2019s safety measures were adequate. For years, its leaders touted<\/a> that promise\u2014the central pillar of their Responsible Scaling Policy (RSP)\u2014as evidence that they are a responsible company that would withstand market incentives to rush to develop a potentially dangerous technology.\u00a0<\/p>\n

But in recent months the company decided to radically overhaul the RSP. That decision included scrapping the promise to not release AI models if Anthropic can\u2019t guarantee proper risk mitigations in advance. <\/p>\n

\u201cWe felt that it wouldn’t actually help anyone for us to stop training AI models,\u201d Anthropic\u2019s chief science officer Jared Kaplan told TIME in an exclusive interview. \u201cWe didn’t really feel, with the rapid advance of AI, that it made sense for us to make unilateral commitments \u2026 if competitors are blazing ahead.\u201d<\/p>\n

The new version of the policy, which TIME reviewed, includes commitments to be more transparent about the safety risks of AI, including making additional disclosures about how Anthropic\u2019s own models fare in safety testing. It commits to matching or surpassing the safety efforts of competitors. And it promises to \u201cdelay\u201d Anthropic\u2019s AI development if leaders both consider Anthropic to be leader of the AI race and think the risks of catastrophe to be significant.\u00a0<\/p>\n

But overall, the change to the RSP leaves Anthropic far less constrained by its own safety policies, which previously categorically barred it from training models above a certain level if appropriate safety measures weren\u2019t already in place.<\/p>\n

The change comes as Anthropic, previously considered to be behind OpenAI in the AI race, rides the high of a string of technological and commercial successes. Its Claude models, especially the software-writing tool Claude Code, have won legions of devoted fans. In February, Anthropic raised $30 billion in new investments, valuing it at some $380 billion, and reported that its annualized revenue was growing at a rate of 10x per year. The company\u2019s core business model of selling direct to businesses is seen by many investors as more credible than OpenAI\u2019s main strategy of monetizing a vast consumer user base.\u00a0<\/p>\n

Kaplan, the Anthropic executive and co-founder, denied the company\u2019s decision to change course was a capitulation to market incentives as the race for superintelligence accelerates. He framed it instead as a pragmatic response to emerging political and scientific realities. \u201cI don\u2019t think we\u2019re making any kind of U-turn,\u201d Kaplan says.<\/p>\n

When Anthropic introduced the RSP in 2023, Kaplan says, the company hoped it would encourage rivals to adopt similar measures. (No rivals made quite as overt a promise to pause AI development, but many published lengthy reports detailing their plans to mitigate risk, which Kaplan chalks up as Anthropic exerting a good influence on the industry.) Executives also hoped the approach might eventually serve as a blueprint for binding national regulations or even international treaties, Kaplan claims. <\/p>\n

But those regulations never materialized. Instead, the Trump Administration has endorsed a let-it-rip attitude to AI development, even going so far as to attempt to nullify state regulations. No federal AI law is on the horizon. And while a global governance framework may have seemed possible in 2023, three years later it has become clear<\/a> that door has closed. Meanwhile, competition for AI supremacy\u2014between companies but also between nations\u2014has only intensified.\u00a0<\/p>\n

To make matters worse, the science of AI evaluations has proven more complicated than Anthropic expected when it first crafted the RSP. The arrival of powerful new models meant that, in 2025, Anthropic announced it could not rule out the possibility of these models facilitating a bio-terrorist attack. But while they couldn\u2019t rule it out, they also lacked strong scientific evidence that models did pose that kind of danger, which made it difficult to convince governments and rivals of what they saw as the need to act carefully. What the company had previously imagined might look like a bright red line was instead coming into focus as a fuzzy gradient.\u00a0<\/p>\n

For nearly a year, Anthropic executives discussed ways to reshape their flagship safety policy to match this new environment, Kaplan says. One point they kept coming back to was their founding premise: the idea that to do proper AI safety research, they had to build models at the frontier of capability\u2014even though doing so might accelerate the arrival of the dangers they feared.\u00a0<\/p>\n

In February, according to Kaplan, Amodei decided that keeping the company from training new models while competitors raced ahead would be helpful to nobody. \u201cIf one AI developer paused development to implement safety measures while others moved forward training and deploying AI systems without strong mitigations, that could result in a world that is less safe,\u201d the new version of the RSP, approved unanimously by Amodei and Anthropic\u2019s board, states in its introduction. \u201cThe developers with the weakest protections would set the pace, and responsible developers would lose their ability to do safety research.\u201d<\/p>\n

Chris Painter, the director of policy at METR, a nonprofit focused on evaluating AI models for risky behavior, reviewed an early draft of the policy with Anthropic\u2019s permission. He says the change is understandable \u2014 but also a bearish signal for the world\u2019s ability to navigate potential AI catastrophes. The change to the RSP shows Anthropic \u201cbelieves it needs to shift into triage mode with its safety plans, because methods to assess and mitigate risk are not keeping up with the pace of capabilities,\u201d Painter tells TIME. \u201cThis is more evidence that society is not prepared for the potential catastrophic risks posed by AI.\u201d<\/p>\n

Anthropic argues the retooled RSP is designed to keep the biggest benefits of the old one. For example, by constraining itself from releasing new models, Anthropic\u2019s original RSP also incentivized it to quickly build safety mitigations. (Because otherwise the company would be unable to sell its AI to customers.) Anthropic says it believes it can maintain that incentive. The new policy commits the company to regularly release what it calls \u201cFrontier Safety Roadmaps\u201d: documents laying out a list of detailed goals for future safety measures it hopes to build.<\/p>\n

\u201cWe hope to create a forcing function for work that would otherwise be challenging to appropriately prioritize and resource, as it requires collaboration (and in some cases sacrifices) from multiple parts of the company and can be at cross-purposes with immediate competitive and commercial priorities,\u201d the new RSP states.<\/p>\n

Anthropic says it will also commit to publishing so-called \u201cRisk Reports\u201d every three to six months. The reports, the company says, will \u201cexplain how capabilities, threat models (the specific ways that models might pose threats), and active risk mitigations fit together, and provide an assessment of the overall level of risk.\u201d These documents will be more in-depth than the reports the company already publishes, a spokesperson tells TIME.<\/p>\n

\u201cI like the emphasis on transparent risk reporting and publicly verifiable safety roadmaps,\u201d says Painter, the METR policy official. But he said he was \u201cconcerned\u201d that moving away from binary thresholds under the previous RSP, by which the arrival of a certain capability could act as a tripwire to temporarily halt Anthropic\u2019s AI development, might enable a \u201cfrog-boiling\u201d effect, where danger slowly ramps up without a single moment that sets off alarms.\u00a0<\/p>\n

Asked whether Anthropic was caving to market pressure, Kaplan argued that, in fact, Anthropic was making a renewed commitment to developing AI safely. \u201cIf all of our competitors are transparently doing the right thing when it comes to catastrophic risk, we are committed to doing as well or better,\u201d he said. \u201cBut we don’t think it makes sense for us to stop engaging with AI research, AI safety, and most likely lose relevance as an innovator who understands the frontier of the technology, in a scenario where others are going ahead and we’re not actually contributing any additional risk to the ecosystem.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Anthropic, the wildly successful AI company that has cast itself as the most safety-conscious of the top research…\n","protected":false},"author":2,"featured_media":444151,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":{"0":"post-444150","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-technology","12":"tag-uk","13":"tag-united-kingdom","14":"tag-unitedkingdom"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/444150","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=444150"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/444150\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/444151"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=444150"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=444150"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=444150"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}