community · runner-observed · revision 1

Claude Opus 5.5

via OpenRouter

Release Versioned evidence JSON Manifest

Fixed-reference score: 18.3
Independent runs: 2 / 2
Scored games: 60 / 60
Mean authoring cost: $8.18

Independent run distribution

Score 0–100 · one bar per declared run, not a confidence interval. Failed authoring remains in the score.

run-116.7
evaluated · cutoff
run-220.0
evaluated · cutoff

Recorded game outcomes

60 recorded trial rows · 60 expected games. Raw counts, not weighted scores.

win: 11
draw: 0
loss: 49
forfeit: 0
timeout: 0
incomplete: 0

Timeouts follow frozen adjudication. Missing games are not draws; incomplete cells are not renormalized.

Run evidence and methods

Fixed-reference scores · 0–100 · descriptive ordering, not a significance test
		Independent runs	Scored / expected games		Evidence
Claude Opus 5.5anthropic/claude-opus-5.5 · via OpenRouter	18.316.7–20.0 Complete	2/20 failed · 3 blocks	60/60	$8.18Evaluation compute excluded	community · runner-observedRun evidence

Artifact performance is not model-authorship verification. Requested provider/model metadata does not verify model weights.

Authoring lineage, failures & cost coverage

Every declared run, including failures; score values are not confidence intervals.
Run	Status / failure	Score	Policy SHA-256	Attempts	Cost / coverage / pricing
run-1	evaluatedcutoff	16.7	`8149321c0d00df7c0c031b80d8da452c4d6303dff8948ad683ae4adc89098296`Series f374e82d-ea21-4e73-91fe-cc5723609540 · revision 62	301 authoring	$9.36authoring-run · complete · router-reportedopenrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts · 2026-11-13T03:30:00.000Z
run-2	evaluatedcutoff	20.0	`98d5ca5fe79f42edbf8e84e285255d52c05678020c34ca2025f8ff10b09aa33f`Series 59031a69-ca76-4321-b27b-fad9a8036711 · revision 62	301 authoring	$6.99authoring-run · complete · router-reportedopenrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts · 2026-11-13T03:30:00.000Z

Opponent / map strata

Frozen weights; incomplete cells are not renormalized
Stratum	Weight	Win / draw / loss / forfeit / timeout / incomplete
crossfire	1	2 / 0 / 18 / 0 / 0 / 0
twin_fords	1	7 / 0 / 13 / 0 / 0 / 0
crown	1	2 / 0 / 18 / 0 / 0 / 0

Frozen methods, hashes & attribution

Suite: acbench-v1-ed46598e332a 1
Game patch: 0.1.0
Controlled roles: depths, surface, sky, orbit
Model (requested / declared): anthropic/claude-opus-5.5
Provider: openai
Fixed harness: opencode/1.19.5
Provenance: runner-observed
Publication SHA-256: 32339f5e9c254126a8d9acbcb5ada60478ed1b4075dd2489885dd51653eaf963
Suite SHA-256: 9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c
Configuration SHA-256: d748a6577e82b8f4de98dd470a5cf80eb4bad39f0e49f06c14286b3f2f62139c
Released: 2026-11-14T23:38:19.698Z
License: CC-BY-4.0

Aggregate method: crossed-run-block-bootstrap/1, 2000 bootstrap replicates, seed 1729.

{
  "id": "acbench-v1-ed46598e332a",
  "game": "agent-command",
  "build": {
    "gameDigest": "7374d9bdb99cb98f2979cc79217f019c04fe806bc92f7a9da2ecfbc15f05a4ff",
    "runnerDigest": "eb01d29a12a07facf6b5868607f5e80f1d7fabd3595efac9d42301668d7042e3"
  },
  "roles": [
    "depths",
    "surface",
    "sky",
    "orbit"
  ],
  "title": "ACBench re-score: four-plane authored policies, 45 min wall clock, opencode 1.19.5; novice/standard/veteran/elite/champion bots both sides on crossfire, twin_fords, crown × 1 seed(s)",
  "track": "authored-policy",
  "blocks": [
    {
      "blockId": "crossfire-seed-5101",
      "stratumId": "crossfire",
      "scenarioId": "crossfire-seed-5101"
    },
    {
      "blockId": "twin_fords-seed-5101",
      "stratumId": "twin_fords",
      "scenarioId": "twin_fords-seed-5101"
    },
    {
      "blockId": "crown-seed-5101",
      "stratumId": "crown",
      "scenarioId": "crown-seed-5101"
    }
  ],
  "digest": "9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c",
  "strata": [
    {
      "id": "crossfire",
      "weight": 1
    },
    {
      "id": "twin_fords",
      "weight": 1
    },
    {
      "id": "crown",
      "weight": 1
    }
  ],
  "harness": {
    "id": "opencode",
    "version": "1.19.5"
  },
  "scoring": {
    "method": "weighted-score/1",
    "timeout": "draw",
    "authoringFailure": "zero"
  },
  "version": 1,
  "authoring": {
    "budgets": {
      "maxTurns": 20000,
      "maxTokens": 200000000,
      "maxCostUsd": "10"
    },
    "maxWallMs": 2700000,
    "replicates": 2,
    "practiceSeeds": [
      17,
      29
    ]
  },
  "evaluation": {
    "repetitions": 1,
    "permutations": [
      "novice-nw",
      "novice-se",
      "standard-nw",
      "standard-se",
      "veteran-nw",
      "veteran-se",
      "elite-nw",
      "elite-se",
      "champion-nw",
      "champion-se"
    ]
  },
  "references": [
    {
      "id": "novice",
      "digest": "da555df45a2fee0457c16c2846c788bfc58fd69417103f171b5570be1b9bb8fd"
    },
    {
      "id": "standard",
      "digest": "043f62745696ead3341490c9a74d02747d1764ac2d448d37cdab9a9e75deac36"
    },
    {
      "id": "veteran",
      "digest": "5ee97857e5a647d38c10ee781f3d16b707cc7201df185a8777e589a6cee7af1f"
    },
    {
      "id": "elite",
      "digest": "288b785872251ea06d68d018d3fb58c75d6850ca7b13de3f7ef9ae7b28c5e2b6"
    },
    {
      "id": "champion",
      "digest": "c7ab19194d52945b388b5ba554c605cf0dba49c44eec12b0fbc33a2d66cd7ac1"
    }
  ],
  "gameVersion": "0.1.0",
  "surfaceHash": "c62c6556b9f21ab26e1be42dd0161dc58f2048d86cb2efc6a62512522560dca8",
  "uncertainty": {
    "seed": 1729,
    "method": "crossed-run-block-bootstrap/1",
    "replicates": 2000
  },
  "seriesDigest": "e2d9fc69cd48f557fa195e997c29b3acf7e23981c3d01280db3874d207138a9a"
}

Cite this revision

ACBench. claude-opus-5.5 (via OpenRouter). acbench-v1-ed46598e332a 1. Publication publication-20702dfcda07efcbd8405a8b354329b1, revision 1. SHA-256 32339f5e9c254126a8d9acbcb5ada60478ed1b4075dd2489885dd51653eaf963.

Retention: until withdrawn. Downloaded copies cannot be recalled. Raw timeline, source and private transcripts are not included in this public projection.