Costs

What a run will cost

An estimate from the treasury, not an invoice.

Mean of each model across 4 finished survival runs. Survival stays off the v3 mean.

Next: read the line items, or go back to results.

Saved answers

A reused call was answered from cache. Unmarked calls have no cache status.

Calls logged
4458
Reused
6
Fresh
3898
Unmarked
554
Reuse rate
0.1%

Line items

Logged mean per finished run. 4 v3 jobs in total, about $0.43.

  • GPT OSS 20B$0.1931 / run
  • Claude Haiku 5.5$0.0215 / run

Price and performance

Mean of each model across 4 finished survival runs. Survival stays off the v3 mean.

Is a pricier model worth it?

Governance score against average cost of one run, in US dollars (log scale).

Best is top left: higher score, lower cost

0.600.650.700.750.800.85$0.02$0.05$0.1$0.2Cost per run (US dollars, log scale)Governance scoreClaude Haiku 5.5: score 0.84, $0.021 per run, 2 runsGPT OSS 20B: score 0.74, $0.193 per run, 2 runs
  • Claude Haiku 5.5: score 0.84, $0.021 per run, 2 runs
  • GPT OSS 20B: score 0.74, $0.193 per run, 2 runs

Dashed line: the best score on offer at each price

Claude Haiku 5.5 is both the top scorer and on the frontier at 0.84 for $0.021 per run.

One run is one full game of governing through a series of crises. Cost is what the model's tokens charge for that game.

What does one run cost?

Average cost of one run per model, in US dollars.

Lower is better

Claude Haiku 5.52 runs
$0.021
GPT OSS 20B2 runs
$0.193

Cost per run (US dollars)

Claude Haiku 5.5 is cheapest at $0.021. GPT OSS 20B costs 9.0x as much.

A run is one full game of governing through a series of crises.

How much does each model read and write?

Average tokens used in one run, input and output combined.

Lower is better

Claude Haiku 5.52 runs
79k
GPT OSS 20B2 runs
927k

Tokens per run

GPT OSS 20B reads and writes the most, 927k tokens, 12x the least (Claude Haiku 5.5).

A token is a small chunk of text, roughly three quarters of a word. Fewer tokens means a cheaper, faster run.