Changelog
Version History
BigAIArena’s Protocol evolves through real Comparisons, not theory. Each version below reflects a genuine operational lesson.
1.5Current Version
| Version | Date | Summary |
|---|---|---|
| 1.5 | 2026-09-06 | Secretary now must produce 2 separate first-tier score tables — one per Phase, never merged or omitted — and must state a reason inline whenever a source is excluded from the average, closing a gap where a Comparison’s total could be computed from an incomplete, unexplained set of reviewers. |
| 1.4 | (previous) | Formatting update for video production and readability: every Comparison record closes each scoring block with a large, clearly separated Access/Trust/Citation/Total summary line, and the Comparison header lists each role on its own line. |
| 1.3 | 2026-09-05 | 9 clarifications from Comparisons #003-008: Independent Audit’s role narrowed to reporting verified facts only (not gate classification); a citation must match the exact concept and location asked, not just “URL exists + content is real” independently; a URL only counts if attached to already-cited content, never a promise to cite later; and — most significantly — any role substitution now requires its own distinct content block, never a relabeled copy of the replaced party’s original numbers, protecting the accountability trail itself. |
| 1.2 | (previous) | Access Gate’s “0 for total access failure” explicitly distinguished from Trust’s separate “self-reported tool failure = 5” rule; a URL inside a markdown link is scored by its actual target destination, not its displayed text. |
| 1.1 | 2026-09-01 | Added that falsely claiming to have verified content directly against the source counts as Hallucination even when the content happens to be accurate. |
| 1.0 | 2026-08-31 | Official public launch. The 8-question/3-criteria (Access/Trust/Citation) architecture, the 3-gate Blind Spot mechanic (Hallucination/Sycophancy/Garbage Substitution), Independent Audit on every Comparison, and Full Check as the sole official record — all built and refined through an extensive internal testing period before this launch. |
A detailed internal changelog documenting every operational fix from the testing period is kept privately by the Arena Master. What’s published here is the standard as it currently operates, starting from official launch.