The real test of OpenAI’s audits is disclosure

•

Nov 16, 2026

•

11:14pm UTC

Copy link
Share on X
Share on LinkedIn
Share on Instagram
Share via Facebook

OpenAI is opening its doors to independent auditors as the stakes to develop safe frontier AI get higher.

On Monday, the AI lab announced that it has signed agreements with four third-party auditors: Apollo Research, METR, Transluce, and Goodfire. These assessors will be embedded across OpenAI's operations, allowing them access to the same internal resources that its researchers have, including model checkpoints, source code, data, monitoring systems and technical documentation.

The announcement marks the first phase of OpenAI's embedded assessments, the company said, with initial evaluations focusing specifically on alignment and safeguards in training and internal use.

Each of these four assessors are responsible for evaluating different parts of OpenAI:

  • Apollo Research will assess whether models can covertly work together against a user's intentions, and if OpenAI's existing safeguards can detect and mitigate this behavior.
  • Goodfire's interpretability researchers are primarily responsible for training run monitoring, debugging, and alignment.
  • METR will be responsible for two assessments, one focused on spotting misaligned behavior within OpenAI's "largest reinforcement learning run to date," and the second being a "stress testing exercise" involving red teaming.
  • Transluce will conduct post-training alignment evaluation on selected public and unreleased OpenAI models.

OpenAI also developed a six-part protocol for third-party auditors, aiming to create a specific scope, secure environment and proper oversight, as well as protocols around public disclosures. Following the initial assessments, OpenAI will publicly report some of the findings and iterate on them for long-term, consistent embedded evaluations. However, the AI lab said that it retains "the right to redact confidential information," as well as request "responsible disclosure delays" to give OpenAI time to act on the findings.

"Especially in the early stages of embedded assessments, we expect technical access challenges, space constraints, evolving security protocols, and other unexpected issues to arise," OpenAI noted in its blog post.

This decision follows a similar move by rival Anthropic, which announced in October that it would give "employee-like access," including access to hardware, office space, and internal tools, to six assessors from METR to evaluate the risks of its frontier models. It also follows OpenAI, Anthropic and several other frontier labs signing a "morally binding" White House pledge to self-regulate, an accord which included promises for partnerships with external auditors.

Our Deeper View

Third-party evaluators have already proven themselves to be a critical part of holding AI labs accountable for building safe frontier systems. Last month, METR published findings that a three-week evaluation of OpenAI's systems, which coincidentally took place during the Hugging Face incident, uncovered a number of vulnerabilities, including ways for agents to circumvent and conceal actions from human monitoring. However, these third-party evaluations only work when the auditors performing them are not muzzled, such as in the case of a recent Reuters report claiming that OpenAI and Anthropic had attempted to control what evaluators published to prevent IP leakage. Independent audits with restrictions on what can actually be publicly released in some respects defeat the purpose, as they threaten the power of accountability that these assessors have. Though OpenAI is acting responsibly in embedding these evaluators at all, the question still remains what, exactly, the public will be able to learn from them.