{"id":883712,"date":"2026-10-15T23:32:13","date_gmt":"2026-10-15T23:32:13","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/883712\/"},"modified":"2026-10-15T23:32:13","modified_gmt":"2026-10-15T23:32:13","slug":"anthropic-update-on-independent-evaluators-anthropic","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/883712\/","title":{"rendered":"Anthropic update on independent evaluators \\ Anthropic"},"content":{"rendered":"

Last month, we committed to stronger independent, third-party assessment<\/a> of our models and safety practices. We also signed the White House Accord on Super Intelligence, in which companies pledged to partner with independent external auditors or evaluators. Today, we\u2019re announcing that we\u2019ve started to give employee-like access to a team from METR<\/a>, a nonprofit that evaluates frontier AI models.<\/p>\n

METR will publish the results of its risk assessments. Over the past year, we\u2019ve worked with METR on several reviews of our Risk Reports<\/a>. We\u2019re also working with SecureBio<\/a> and Accenture<\/a> as evaluators, and are in early discussions with several other organizations, including Hugging Face<\/a>.<\/p>\n

Here, we explain our approach to working with evaluators.<\/p>\n

Why we work with independent evaluators<\/p>\n

As models have become more powerful, they\u2019ve required stronger safeguards and more challenging risk assessments. We want to be publicly accountable for the decisions we\u2019re making. But we can\u2019t publicly share all the information relevant to our safety work. Some of it could be useful to malicious actors, or is commercially sensitive, like compute or training information. Instead, we\u2019re giving third-party evaluators deep access to our information, and are having them share evidence and reasoned conclusions about the risks involved in building our models. We aim to close the gap between what evaluators understand about a frontier AI company\u2019s systems and what the company itself understands.<\/p>\n

To evaluate frontier models, evaluators need the following:<\/p>\n

Expertise in assessing the capabilities of frontier models, including understanding the way evaluations can go wrong, such as alignment faking<\/a>.Independence: they shouldn\u2019t hold equity in the company they\u2019re evaluating, or be financially or operationally dependent on it.Enough access to meaningfully evaluate risks. Beyond access to the latest models, evaluators also need visibility into how those models were trained, into how our safeguards function, and more.Freedom to publish observations and assessments of a model or a process.<\/p>\n

Although the analogy isn\u2019t exact, bank supervision operates on similar logic. Banks know more about their own risk positions than outsiders do, so regulators assign resident examiners to work inside the largest banks. If a bank\u2019s risk-taking could threaten the public, third parties try to see that in advance.<\/p>\n

For the AI industry, this is a step toward robust safety oversight<\/a>. We\u2019re moving quickly with multiple evaluators and learning actively about what kinds of partnership work. We\u2019re committed to sharing updates as we go.<\/p>\n

What we mean by \u201cemployee-like access\u201d<\/p>\n

We\u2019ve onboarded six METR employees with company hardware, office space, and access to internal tools and systems that are roughly on par with what our own risk assessment teams have access to. Outside a small number of clearly defined categories (e.g., data about customers, attorney-client privileged information, or information about our model architectures), Anthropic employees are encouraged to share information with them just as they would with a fellow employee working on alignment risk.1<\/a><\/p>\n

METR will publish its analysis of our risk levels, incidents, or practices. Anthropic can\u2019t veto publication, but we can require them to redact information if it falls into narrow, predefined categories like the ones above. METR is free to characterize our redactions publicly, and say whether it believes the redactions were justified, as long as it does so without revealing the redacted information.<\/p>\n

Our engagement with METR is limited to a small team operating under enforceable agreements. Other METR employees are siloed from that team\u2019s work, including researchers who work with us on other projects. Embedded evaluation gives a few qualified people working under Anthropic\u2019s security standards a close view of how we operate. It\u2019s not a way for other organizations to obtain our information, or that of our customers and partners.<\/p>\n

Our other evaluator partnerships<\/p>\n

We\u2019re working on several other partnerships. Because these other partnerships are still in early stages, we\u2019re providing these evaluators with more limited information, and they have more limited publication rights. Our goal with these early engagements is to make sure that our partners protect confidential information and have the requisite resources and expertise to evaluate our models. As partnerships progress and we build trust, we hope to fully embed more independent evaluators.<\/p>\n

We\u2019re developing three tiers of access for evaluators. Over time, we hope to have several evaluators at the third tier, with each team publishing their own analysis of our risk posture and key decisions.<\/p>\n

In the first tier, evaluators conduct narrowly scoped risk investigations. We decide what access to provide a first-tier evaluator, and evaluators can publish their findings with our approval.<\/p>\n

In the second tier, evaluators can publish without our approval, and they have access to more information. We can still require removal of specific categories of information, though evaluators can publish their views on whether our redactions were justified.<\/p>\n

The third tier is the arrangement we\u2019ve described with METR, with employee-like access and publication rights similar to those of the second tier.<\/p>\n

SecureBio is in the process of reviewing the chemical and biological weapons chapter of our August Risk Report<\/a>, after completing and publishing a pilot review<\/a> of our previous risk report. After this review is complete, we will consider moving to projects with increased access.<\/p>\n

With Accenture and Faculty, we’re working toward an ambitious partnership<\/a> that includes evaluating and red-teaming models, conducting alignment assessments, testing model safeguards, and building capabilities across our organizations.<\/p>\n

We\u2019re embedding evaluators voluntarily, and we believe every frontier AI company should do the same.<\/p>\n","protected":false},"excerpt":{"rendered":"Last month, we committed to stronger independent, third-party assessment of our models and safety practices. We also signed…\n","protected":false},"author":2,"featured_media":883713,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,74],"class_list":["post-883712","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/883712","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=883712"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/883712\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/883713"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=883712"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=883712"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=883712"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}