Methods & About
AI Review Council
Before a piece of work is reported, a model from a different family from its author reviews the evidence. A verdict covers only the files sent to the reviewer and does not stand in for the auditor.
46Review rowsIncluding reviews that did not pass
19PASS verdicts
27UNCLEAR or FIX_REQUIREDKept with the fixes that followed
$1.49Recorded review costFrom the review harness receipts
Reviewers
Claude Haiku
1 review rows
Claude Opus 5.5
5 review rows
azure/gpt-5.4-mini
28 review rows
azure/gpt-6.1-sol
12 review rows
Review records
| Date | Scope reviewed | Reviewer | Verdict | USD | Record |
|---|---|---|---|---|---|
| 2026-11-14 | 19-1 phenotype score equivalence, the top-five boundary and synthetic ACMG evidence attribution | Claude Opus 5.5 | PASS | 0.0970 | docs/AJA-REVIEW.md |
| 2026-11-14 | Registration of twelve projects, internal targets against the call and the scope of tests and sign-off | Claude Opus 5.5 | PASS | 0.0755 | docs/AJA-REVIEW.md |
| 2026-11-14 | Four earlier Claude Haiku reviews of the same two scopes before corrections | Claude Haiku | 2 UNCLEAR · 2 FIX_REQUIRED | 0.0135 | docs/AJA-REVIEW.md |
| 2026-11-14 | 19-1 public time split, HPO inputs, metrics and ClinVar comparison | Claude Opus 5.5 | PASS | 0.0785 | docs/review/GATE1-AJA.md |
| 2026-11-14 | Shared registry and site check, first attempt; the response was cut off | Claude Opus 5.5 | UNCLEAR | 0.0942 | docs/review/GATE1-AJA.md |
| 2026-11-14 | Shared registry and site check, final | Claude Opus 5.5 | PASS | 0.0863 | docs/review/GATE1-AJA.md |
| 2026-11-14 | 12-1 and 12-3 statistical guarantees, first review | azure/gpt-5.4-mini | UNCLEAR | 0.0135 | docs/review/PREVENT12-AJA.md |
| 2026-11-14 | 12-2 and 12-4 safety invariants, first review | azure/gpt-5.4-mini | UNCLEAR | 0.0118 | docs/review/PREVENT12-AJA.md |
| 2026-11-14 | 12-1 and 12-3 statistical guarantees, re-review after three fixes | azure/gpt-5.4-mini | PASS | 0.0134 | docs/review/PREVENT12-AJA.md |
| 2026-11-14 | 12-2 and 12-4 safety invariants, re-review after three fixes | azure/gpt-5.4-mini | PASS | 0.0121 | docs/review/PREVENT12-AJA.md |
| 2026-11-14 | Site integration contract against its implementation: failed or unknown audits stop the build, nothing is written before every check passes | azure/gpt-5.4-mini | PASS | 0.0134 | docs/review/IATHEON-PARITY.md |
| 2026-11-14 | IATHEON comparison record and the 12-1 to 12-4 summary wording, first review; no specific defect was named | azure/gpt-5.4-mini | UNCLEAR | 0.0135 | docs/review/IATHEON-PARITY.md |
| 2026-11-14 | IATHEON comparison record and the 12-1 to 12-4 summary wording, re-review after the scope of each section was stated | azure/gpt-5.4-mini | PASS | 0.0123 | docs/review/IATHEON-PARITY.md |
| 2026-11-14 | Audit gate and rule table, first review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0144 | acmg19-aja.md |
| 2026-11-14 | Audit gate and rule table, second review | azure/gpt-5.4-mini | PASS | 0.0167 | acmg19-aja.md |
| 2026-11-14 | Literature step, first review | azure/gpt-5.4-mini | UNCLEAR | 0.0146 | acmg19-aja.md |
| 2026-11-14 | Literature step, second review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0124 | acmg19-aja.md |
| 2026-11-14 | Move into APOSTOLUS, first review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0093 | acmg19-aja.md |
| 2026-11-14 | Move into APOSTOLUS, second review | azure/gpt-5.4-mini | UNCLEAR | 0.0110 | acmg19-aja.md |
| 2026-11-14 | Move into APOSTOLUS, third review | azure/gpt-5.4-mini | PASS | 0.0114 | acmg19-aja.md |
| 2026-11-14 | Site summary wording | azure/gpt-5.4-mini | PASS | 0.0109 | acmg19-aja.md |
| 2026-11-14 | 16-2 harness and specification, first review | azure/gpt-5.4-mini | UNCLEAR | 0.0142 | cog16-review.md |
| 2026-11-14 | 16-3 harness and specification, first review | azure/gpt-5.4-mini | UNCLEAR | 0.0124 | cog16-review.md |
| 2026-11-14 | 16-2 harness and specification, second review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0158 | cog16-review.md |
| 2026-11-14 | 16-3 harness and specification, second review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0170 | cog16-review.md |
| 2026-11-14 | 16-2 harness and specification, third review | azure/gpt-5.4-mini | UNCLEAR | 0.0178 | cog16-review.md |
| 2026-11-14 | 16-3 harness and specification, third review | azure/gpt-5.4-mini | UNCLEAR | 0.0099 | cog16-review.md |
| 2026-11-14 | 16-2 auditor and replay record | azure/gpt-5.4-mini | UNCLEAR | 0.0144 | cog16-review.md |
| 2026-11-14 | 16-3 auditor, first review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0127 | cog16-review.md |
| 2026-11-14 | 16-3 auditor, second review | azure/gpt-5.4-mini | FIX_REQUIRED | 0.0094 | cog16-review.md |
| 2026-11-14 | 16-3 auditor, third review | azure/gpt-5.4-mini | UNCLEAR | 0.0091 | cog16-review.md |
| 2026-11-14 | 16-2 abrupt-change detector variant | azure/gpt-5.4-mini | UNCLEAR | 0.0172 | cog16-review.md |
| 2026-11-14 | 18-2 specification and core modules, first review | azure/gpt-5.4-mini | 2 FIX_REQUIRED | 0.0308 | synth8-dispense18-review.md |
| 2026-11-14 | 18-2 gate mathematics, kernel, audit trail and rule engine, rounds before the final ones | azure/gpt-6.1-sol | 8 FIX_REQUIRED | 0.2304 | synth8-dispense18-review.md |
| 2026-11-14 | 18-2 Gate B and drift-monitor mathematics, final | azure/gpt-6.1-sol | PASS | 0.0277 | synth8-dispense18-review.md |
| 2026-11-14 | 18-2 fail-closed kernel and audit trail, final | azure/gpt-6.1-sol | PASS | 0.0265 | synth8-dispense18-review.md |
| 2026-11-14 | 18-2 DUR rule engine and MIMIC-IV mapping, final | azure/gpt-6.1-sol | PASS | 0.0298 | synth8-dispense18-review.md |
| 2026-11-14 | 18-2 site summary wording against the audit file, final | azure/gpt-6.1-sol | PASS | 0.0203 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 specification and core modules, first review | azure/gpt-5.4-mini | 1 FIX_REQUIRED · 1 UNCLEAR | 0.0362 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 differential-privacy core, rounds before the final one | azure/gpt-6.1-sol | 3 FIX_REQUIRED | 0.1045 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 differential-privacy core: sensitivities, accounting, AUROC bound, final | azure/gpt-6.1-sol | PASS | 0.0304 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 preservation rule, privacy gate and measured results, earlier rounds | azure/gpt-6.1-sol | 1 PASS · 1 FIX_REQUIRED | 0.0644 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 preservation rule, privacy gate and measured results, final | azure/gpt-6.1-sol | PASS | 0.0323 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 site summary wording against the audit file, first review | azure/gpt-6.1-sol | FIX_REQUIRED | 0.0230 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 site summary wording against the audit file, final | azure/gpt-6.1-sol | PASS | 0.0218 | synth8-dispense18-review.md |
| 2026-11-14 | 8-1 site summary after binding the baseline-ceiling sentence to the calibration evidence | azure/gpt-6.1-sol | PASS | 0.0244 | synth8-dispense18-review.md |
What a review covers
A review checks that the claims, the code and the numbers in the files it received agree with one another. Real cohorts, clinical validity, clinical review of approved wording and the auditor’s signature are outside every review listed here.