Runs
v3.1-survival
4 complete · 0 failed · 4 called. Survival stays off the v3 mean.
The scoreboard
Finished runs in v3.1-survival. One dot is a model.
Which model governs best?
Average governance score per model across all its runs, from 0 to 1.
Governance score (0 to 1)
Claude Haiku 5.5 leads at 0.84, 0.10 ahead of GPT OSS 20B. GPT OSS 20B is last at 0.74.
Governance score blends the values a model upholds, how its country fares, and how honest and unselfish it is.
Is a pricier model worth it?
Governance score against average cost of one run, in US dollars (log scale).
- Claude Haiku 5.5: score 0.84, $0.021 per run, 2 runs
- GPT OSS 20B: score 0.74, $0.193 per run, 2 runs
Dashed line: the best score on offer at each price
Claude Haiku 5.5 is both the top scorer and on the frontier at 0.84 for $0.021 per run.
One run is one full game of governing through a series of crises. Cost is what the model's tokens charge for that game.
Is a slower model worth the wait?
Governance score against average time for one run, in seconds.
- Claude Haiku 5.5: score 0.84, 6 min 15 s, 2 runs
- GPT OSS 20B: score 0.74, 14 min 44 s, 2 runs
Dashed line: the best score on offer at each speed
Claude Haiku 5.5 is both the top scorer and on the frontier at 0.84 for 6 min 15 s per run.
Time is how long the model spent thinking and answering across a whole run, not counting queue waits.