Testing · validation · operation

Test the system. Challenge the institution. Then decide whether to pilot.

FASO’s complete Test Rig provides governed internal evidence about the built system. Independent specialists must separately challenge the technical proposition and the proposed institution. None of these stages authorises operation automatically.

Non-collapse ruleThe Test Rig tests the FASO System. Independent system validation tests the technical proposition. Institutional validation tests the organisation, governance and candidate Frozen Core. A controlled pilot tests operation. They are separate gates.

The complete Test Rig

Complete-system execution with reproducible evidence.

The Test Rig exists to exercise the complete FASO System reproducibly—not merely one software seam or one model route.

01

Governed scope

Fix the execution identity, scope, authority, controlled evidence, expected outcomes and integrity references before execution.

02

Traceable execution

Give every assessed outcome its own immutable identity, timing, evidence, expected and actual result, status and explanation.

03

Complete routing

Exercise every applicable accepted system pathway without bypassing a governed stage.

04

Visible evidence

Present complete and linked results in the operator console with access to individual outcomes and state placement.

05

Protected-state proof

Demonstrate that assurance activity has not modified protected source, accepted evidence or authority records.

Internal system testing

Can the built system perform its accepted functions correctly?

  • Controlled by FASO
  • Uses accepted governed data
  • Finds and records software or data faults
  • Supports separate authorised repair

Independent system validation

Does the underlying monitoring proposition survive external challenge?

  • Controlled by an independent partner
  • Uses blinded evidence and external ground truth
  • Sets thresholds before results are known
  • May confirm, qualify or reject the proposition

Institutional validation

Can the proposed organisation protect its purpose and remain accountable?

  • Compares legal and governance options
  • Tests authority, conflicts and funding independence
  • Challenges the candidate Frozen Core
  • May reject the proposed organisational model

Controlled pilot

Can the validated system and institution operate safely together?

  • Uses explicit scope and stopping conditions
  • Tests real governance decisions and operational burden
  • Preserves external challenge and incident evidence
  • Does not authorise wider operation automatically

Proposed independent process

Five stages controlled by the validating institution.

FASO supplies the frozen system, authorities, internal evidence and technical support. It must not control withheld outcomes, success criteria or the final report.

01
Protocol and preregistration

Cases, ground truth, hypotheses, metrics, security, thresholds and reporting rules fixed independently.

02
Retrospective blind replay

Time-ordered evidence released without later outcomes being available prematurely.

03
Negative and alternative controls

Benign, authorised, degraded and ambiguous conditions test false alarms and robustness.

04
Comparative and adversarial testing

Compare FASO with current review and challenge the method under evasion, ambiguity and long trajectories.

05
Independent conclusion

The external partner controls analysis, limitations and the final published report.

From test to operation

Evidence—not momentum—opens the next gate.

Timing is indicative. Every stage requires a separate decision, defined evidence and explicit authority.

0

Weeks 0–4

Scoping

Feasible and independently governable?

1

Months 2–3

Blind validation

Does the hypothesis survive?

2

Months 4–6

Adversarial validation

Is performance robust enough?

3

Months 7–9

Shadow deployment

Can it operate without unsafe burden?

4

Months 10–12

First scaling

Is wider deployment justified?

Independent challenge

The proposition must remain capable of failing.

FASO is seeking reviewers and a prospective independent team willing to challenge the method, evidence and institutional assumptions.