1. Home
  2. Encyclopedia
  3. Outside testing

RSI Encyclopedia · Term

Outside testing

Outside testing is the evaluation of an SI model before release by government institutes and independent experts rather than the lab alone, and it is one of the five Containment Board grades.

Category
Term
Also called
pre-deployment testing, third-party evaluation, external evaluation
Rogue Log cases
0
Laws that use it
7

In plain English

A lab testing its own model has a conflict of interest: it wants to ship. Outside testing brings in evaluators with no stake in the release, such as the UK AI Security Institute, the US CAISSI and independent organizations like METR and Apollo Research, to probe for dangerous capabilities and misaligned behavior before the public gets access.

The value depends on the details. Testers need enough time, access to the most capable version of the model and freedom to publish what they find. In practice access is often days or weeks, under agreements set by the lab, and results may be published only after company review. The Containment Board grades each lab on whether its latest flagship was tested by outsiders before release, how deep their access was and whether results were published. The EU General-Purpose AI Code of Practice now expects external evaluation of the most capable models, with limited exemptions.

Why it matters for rogue SI

Outside testers are often the first independent eyes on a new frontier model. Many early signs of rogue behavior come from their reports.

Laws and rules that use it

Sources

  1. The General-Purpose AI Code of Practice European Commission ·
  2. H.R. 9925, FRONTIER Act, 119th Congress LegiScan

The RSI Encyclopedia

Keep reading

207 entries on the terms, labs, models, laws and events of rogue SI, plus every case in the Rogue Incident Database.

Enter RSI

Every term, lab, model and law

Browse the full A to Z index, filter by category or search for a name.