Skip to evidence

ACBench v0.1

14 Nov 2026 · Community

Win rate vs built-in bots, 0–100 · error bars: 95% range · all via OpenRouter† DeepSeek V4.1 Flash: authored on a later game build.

Claude Opus 5.5 leads at 18, not clearly ahead of GPT-6.1 Sol (13).
All models score below the built-in starters (37).

Win rate by opponent

Win rate 0–100 against each opponent, weakest first. The gap to 100 at the hardest tier is the headroom. No bar means unscored, not zero.

Dashed line: the built-in starters against that opponent.† DeepSeek V4.1 Flash: authored on a later game build.

Run-to-run variance

Each model writes its policy several times from scratch; the spread shows how repeatable its score is.

Dot: one authoring run · line: lowest to highest · tick: mean · band: ±1σ. Unscored runs are left out, not zero.† DeepSeek V4.1 Flash: authored on a later game build.

Results and evidence

Systems selected: 2
Independent runs: 4 / 4
Scored games: 120 / 120
Priced systems: 2

Fixed-reference scores · 0–100 · descriptive ordering, not a significance test
		Independent runs	Scored / expected games		Evidence
Claude Opus 5.5anthropic/claude-opus-5.5 · via OpenRouter	18.316.7–20.0 Complete	2/20 failed · 3 blocks	60/60	$8.18Evaluation compute excluded	community · runner-observedRun evidence
GPT-6.1 Solopenai/gpt-6.1-sol · via OpenRouter	13.30.0–26.7 Complete	2/20 failed · 3 blocks	60/60	$2.39Evaluation compute excluded	community · runner-observedRun evidence

Download evidence Manifest & checksums Score CSV Methods

Comparison rules & frozen release identity

Official comparisons hold harness/version, prompt/tool profile and budget fixed. Alternate harnesses use separate system-comparison suites. Filters retain the exact suite and configuration. Neither patches nor budgets are pooled.

Optional catalogue suggestions are discovery metadata, not authorship evidence.

community · runner-observed · revision 1. Published 2026-11-14T23:38:19.698Z · public release 2026-11-14T23:38:19.698Z.

SHA-256 f90e07425383f91c3bcb58e64fe49aa745555f60c9b96c7eb2599ebf4a2b1a1e

Cite: ACBench, ACBench v0.1, acbench-v0-1, revision 1, 2026-11-14T23:38:19.698Z.

{"page":{"kind":"release","title":"ACBench v0.1","canonical":"https://agentcommand.gg/benchmarks/community/acbench-v0-1/1/","image":"https://agentcommand.gg/benchmarks/community/acbench-v0-1/1/og.png","releases":[],"rows":[{"publication":{"id":"publication-20702dfcda07efcbd8405a8b354329b1","runs":[{"id":"run-1","cost":{"scope":"authoring-run","amount":"9.364768800000","source":"router-reported","coverage":"complete","currency":"USD","pricedAt":"2026-11-13T03:30:00.000Z","pricingVersion":"openrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts"},"index":0,"reason":"cutoff","status":"evaluated","trials":[{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-0","attempts":1,"stratumId":"crossfire","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-1","attempts":1,"stratumId":"crossfire","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-2","attempts":1,"stratumId":"crossfire","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-3","attempts":1,"stratumId":"crossfire","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-4","attempts":1,"stratumId":"crossfire","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-5","attempts":1,"stratumId":"crossfire","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-6","attempts":1,"stratumId":"crossfire","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-7","attempts":1,"stratumId":"crossfire","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-8","attempts":1,"stratumId":"crossfire","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-9","attempts":1,"stratumId":"crossfire","permutationId":"champion-se"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-10","attempts":1,"stratumId":"twin_fords","permutationId":"novice-nw"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-11","attempts":1,"stratumId":"twin_fords","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-12","attempts":1,"stratumId":"twin_fords","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-13","attempts":1,"stratumId":"twin_fords","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-14","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-15","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-16","attempts":1,"stratumId":"twin_fords","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-17","attempts":1,"stratumId":"twin_fords","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-18","attempts":1,"stratumId":"twin_fords","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-19","attempts":1,"stratumId":"twin_fords","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-20","attempts":1,"stratumId":"crown","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-21","attempts":1,"stratumId":"crown","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"crown-seed-5101","trialId":"trial-22","attempts":1,"stratumId":"crown","permutationId":"standard-nw"},{"score":1,"status":"win","blockId":"crown-seed-5101","trialId":"trial-23","attempts":1,"stratumId":"crown","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-24","attempts":1,"stratumId":"crown","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-25","attempts":1,"stratumId":"crown","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-26","attempts":1,"stratumId":"crown","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-27","attempts":1,"stratumId":"crown","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-28","attempts":1,"stratumId":"crown","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-29","attempts":1,"stratumId":"crown","permutationId":"champion-se"}],"seriesId":"f374e82d-ea21-4e73-91fe-cc5723609540","startedAt":"2026-11-13T23:26:07.076Z","finishedAt":"2026-11-14T22:33:39.961Z","artifactDigest":"8149321c0d00df7c0c031b80d8da452c4d6303dff8948ad683ae4adc89098296","seriesRevision":62,"authoringAttempts":1},{"id":"run-2","cost":{"scope":"authoring-run","amount":"6.993429600000","source":"router-reported","coverage":"complete","currency":"USD","pricedAt":"2026-11-13T03:30:00.000Z","pricingVersion":"openrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts"},"index":1,"reason":"cutoff","status":"evaluated","trials":[{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-0","attempts":1,"stratumId":"crossfire","permutationId":"novice-nw"},{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-1","attempts":1,"stratumId":"crossfire","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-2","attempts":1,"stratumId":"crossfire","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-3","attempts":1,"stratumId":"crossfire","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-4","attempts":1,"stratumId":"crossfire","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-5","attempts":1,"stratumId":"crossfire","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-6","attempts":1,"stratumId":"crossfire","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-7","attempts":1,"stratumId":"crossfire","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-8","attempts":1,"stratumId":"crossfire","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-9","attempts":1,"stratumId":"crossfire","permutationId":"champion-se"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-10","attempts":1,"stratumId":"twin_fords","permutationId":"novice-nw"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-11","attempts":1,"stratumId":"twin_fords","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-12","attempts":1,"stratumId":"twin_fords","permutationId":"standard-nw"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-13","attempts":1,"stratumId":"twin_fords","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-14","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-15","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-16","attempts":1,"stratumId":"twin_fords","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-17","attempts":1,"stratumId":"twin_fords","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-18","attempts":1,"stratumId":"twin_fords","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-19","attempts":1,"stratumId":"twin_fords","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-20","attempts":1,"stratumId":"crown","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-21","attempts":1,"stratumId":"crown","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-22","attempts":1,"stratumId":"crown","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-23","attempts":1,"stratumId":"crown","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-24","attempts":1,"stratumId":"crown","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-25","attempts":1,"stratumId":"crown","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-26","attempts":1,"stratumId":"crown","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-27","attempts":1,"stratumId":"crown","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-28","attempts":1,"stratumId":"crown","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-29","attempts":1,"stratumId":"crown","permutationId":"champion-se"}],"seriesId":"59031a69-ca76-4321-b27b-fad9a8036711","startedAt":"2026-11-14T00:26:32.039Z","finishedAt":"2026-11-14T23:06:25.546Z","artifactDigest":"98d5ca5fe79f42edbf8e84e285255d52c05678020c34ca2025f8ff10b09aa33f","seriesRevision":62,"authoringAttempts":1}],"score":{"value":0.18333333333333335,"complete":true,"interval":[0.16666666666666666,0.2],"runScores":[0.16666666666666666,0.2],"failedRuns":0,"uncertainty":{"runs":2,"seed":1729,"blocks":3,"method":"crossed-run-block-bootstrap/1","replicates":2000},"expectedRuns":2,"scoredTrials":60,"completedRuns":2,"expectedTrials":60},"suite":{"id":"acbench-v1-ed46598e332a","game":"agent-command","build":{"gameDigest":"7374d9bdb99cb98f2979cc79217f019c04fe806bc92f7a9da2ecfbc15f05a4ff","runnerDigest":"eb01d29a12a07facf6b5868607f5e80f1d7fabd3595efac9d42301668d7042e3"},"roles":["depths","surface","sky","orbit"],"title":"ACBench re-score: four-plane authored policies, 45 min wall clock, opencode 1.19.5; novice/standard/veteran/elite/champion bots both sides on crossfire, twin_fords, crown × 1 seed(s)","track":"authored-policy","blocks":[{"blockId":"crossfire-seed-5101","stratumId":"crossfire","scenarioId":"crossfire-seed-5101"},{"blockId":"twin_fords-seed-5101","stratumId":"twin_fords","scenarioId":"twin_fords-seed-5101"},{"blockId":"crown-seed-5101","stratumId":"crown","scenarioId":"crown-seed-5101"}],"digest":"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c","strata":[{"id":"crossfire","weight":1},{"id":"twin_fords","weight":1},{"id":"crown","weight":1}],"harness":{"id":"opencode","version":"1.19.5"},"scoring":{"method":"weighted-score/1","timeout":"draw","authoringFailure":"zero"},"version":1,"authoring":{"budgets":{"maxTurns":20000,"maxTokens":200000000,"maxCostUsd":"10"},"maxWallMs":2700000,"replicates":2,"practiceSeeds":[17,29]},"evaluation":{"repetitions":1,"permutations":["novice-nw","novice-se","standard-nw","standard-se","veteran-nw","veteran-se","elite-nw","elite-se","champion-nw","champion-se"]},"references":[{"id":"novice","digest":"da555df45a2fee0457c16c2846c788bfc58fd69417103f171b5570be1b9bb8fd"},{"id":"standard","digest":"043f62745696ead3341490c9a74d02747d1764ac2d448d37cdab9a9e75deac36"},{"id":"veteran","digest":"5ee97857e5a647d38c10ee781f3d16b707cc7201df185a8777e589a6cee7af1f"},{"id":"elite","digest":"288b785872251ea06d68d018d3fb58c75d6850ca7b13de3f7ef9ae7b28c5e2b6"},{"id":"champion","digest":"c7ab19194d52945b388b5ba554c605cf0dba49c44eec12b0fbc33a2d66cd7ac1"}],"gameVersion":"0.1.0","surfaceHash":"c62c6556b9f21ab26e1be42dd0161dc58f2048d86cb2efc6a62512522560dca8","uncertainty":{"seed":1729,"method":"crossed-run-block-bootstrap/1","replicates":2000},"seriesDigest":"e2d9fc69cd48f557fa195e997c29b3acf7e23981c3d01280db3874d207138a9a"},"digest":"32339f5e9c254126a8d9acbcb5ada60478ed1b4075dd2489885dd51653eaf963","format":"playerthree.benchmark-publication","consent":{"license":"CC-BY-4.0","results":true,"research":true,"training":false,"artifacts":false,"attribution":true},"version":1,"revision":1,"retention":{"policy":"until-withdrawn","withdrawalNotice":"Downloaded copies cannot be recalled."},"experiment":{"id":"claude-opus-5.5","digest":"df881b3a000cc6e7e0f96e3402625c463775b56656c542a4d0b247fdf180760d","system":{"id":"claude-opus-5.5","label":"claude-opus-5.5 (via OpenRouter)","model":"anthropic/claude-opus-5.5","harness":"opencode/1.19.5","provider":"openai","configurationDigest":"d748a6577e82b8f4de98dd470a5cf80eb4bad39f0e49f06c14286b3f2f62139c"},"provenance":"runner-observed","replicates":2,"suiteDigest":"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c","executionDigest":"1e562fe4f1e85e4902853dd5b1c9b632cebb44e728a282a6d023835bbd62cf83"},"publishedAt":"2026-11-14T23:37:51.315Z"},"releaseId":"acbench-v0-1","releaseRevision":1,"publisher":"community","evidence":"runner-observed","releasedAt":"2026-11-14T23:38:19.698Z","correction":null,"supersedes":null},{"publication":{"id":"publication-004d85c66ca2eea1e6ffcac521260058","runs":[{"id":"run-1","cost":{"scope":"authoring-run","amount":"0.094920224560","source":"router-reported","coverage":"complete","currency":"USD","pricedAt":"2026-11-13T03:30:00.000Z","pricingVersion":"openrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts"},"index":0,"reason":"cutoff","status":"evaluated","trials":[{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-0","attempts":1,"stratumId":"crossfire","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-1","attempts":1,"stratumId":"crossfire","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-2","attempts":1,"stratumId":"crossfire","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-3","attempts":1,"stratumId":"crossfire","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-4","attempts":1,"stratumId":"crossfire","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-5","attempts":1,"stratumId":"crossfire","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-6","attempts":1,"stratumId":"crossfire","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-7","attempts":1,"stratumId":"crossfire","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-8","attempts":1,"stratumId":"crossfire","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-9","attempts":1,"stratumId":"crossfire","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-10","attempts":1,"stratumId":"twin_fords","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-11","attempts":1,"stratumId":"twin_fords","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-12","attempts":1,"stratumId":"twin_fords","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-13","attempts":1,"stratumId":"twin_fords","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-14","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-15","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-16","attempts":1,"stratumId":"twin_fords","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-17","attempts":1,"stratumId":"twin_fords","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-18","attempts":1,"stratumId":"twin_fords","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-19","attempts":1,"stratumId":"twin_fords","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-20","attempts":1,"stratumId":"crown","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-21","attempts":1,"stratumId":"crown","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-22","attempts":1,"stratumId":"crown","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-23","attempts":1,"stratumId":"crown","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-24","attempts":1,"stratumId":"crown","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-25","attempts":1,"stratumId":"crown","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-26","attempts":1,"stratumId":"crown","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-27","attempts":1,"stratumId":"crown","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-28","attempts":1,"stratumId":"crown","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-29","attempts":1,"stratumId":"crown","permutationId":"champion-se"}],"seriesId":"4d55f5f0-9849-4411-be0b-b9e61090cc76","startedAt":"2026-11-14T01:32:08.369Z","finishedAt":"2026-11-14T22:05:13.258Z","artifactDigest":"8ab7d2dd77ef48dcf9dfba09ec9cefeebc2d1e151e29f09ea86769fbdc6768a2","seriesRevision":62,"authoringAttempts":1},{"id":"run-2","cost":{"scope":"authoring-run","amount":"0.039163967360","source":"router-reported","coverage":"complete","currency":"USD","pricedAt":"2026-11-13T03:30:00.000Z","pricingVersion":"openrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts"},"index":1,"reason":"cutoff","status":"evaluated","trials":[{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-0","attempts":1,"stratumId":"crossfire","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-1","attempts":1,"stratumId":"crossfire","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-2","attempts":1,"stratumId":"crossfire","permutationId":"standard-nw"},{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-3","attempts":1,"stratumId":"crossfire","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-4","attempts":1,"stratumId":"crossfire","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-5","attempts":1,"stratumId":"crossfire","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-6","attempts":1,"stratumId":"crossfire","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-7","attempts":1,"stratumId":"crossfire","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-8","attempts":1,"stratumId":"crossfire","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-9","attempts":1,"stratumId":"crossfire","permutationId":"champion-se"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-10","attempts":1,"stratumId":"twin_fords","permutationId":"novice-nw"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-11","attempts":1,"stratumId":"twin_fords","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-12","attempts":1,"stratumId":"twin_fords","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-13","attempts":1,"stratumId":"twin_fords","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-14","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-15","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-16","attempts":1,"stratumId":"twin_fords","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-17","attempts":1,"stratumId":"twin_fords","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-18","attempts":1,"stratumId":"twin_fords","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-19","attempts":1,"stratumId":"twin_fords","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-20","attempts":1,"stratumId":"crown","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-21","attempts":1,"stratumId":"crown","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-22","attempts":1,"stratumId":"crown","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-23","attempts":1,"stratumId":"crown","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-24","attempts":1,"stratumId":"crown","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-25","attempts":1,"stratumId":"crown","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-26","attempts":1,"stratumId":"crown","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-27","attempts":1,"stratumId":"crown","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-28","attempts":1,"stratumId":"crown","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-29","attempts":1,"stratumId":"crown","permutationId":"champion-se"}],"seriesId":"74ce1680-5eb5-4fad-a7bf-007118a77903","startedAt":"2026-11-14T02:46:08.337Z","finishedAt":"2026-11-14T22:30:55.340Z","artifactDigest":"b0e4bcd5e8d8eecca366f39cf79a346a01f842532a528b5e5d72ed074cd21cf4","seriesRevision":62,"authoringAttempts":1}],"score":{"value":0.06666666666666667,"complete":true,"interval":[0,0.13333333333333333],"runScores":[0,0.13333333333333333],"failedRuns":0,"uncertainty":{"runs":2,"seed":1729,"blocks":3,"method":"crossed-run-block-bootstrap/1","replicates":2000},"expectedRuns":2,"scoredTrials":60,"completedRuns":2,"expectedTrials":60},"suite":{"id":"acbench-v1-ed46598e332a","game":"agent-command","build":{"gameDigest":"7374d9bdb99cb98f2979cc79217f019c04fe806bc92f7a9da2ecfbc15f05a4ff","runnerDigest":"eb01d29a12a07facf6b5868607f5e80f1d7fabd3595efac9d42301668d7042e3"},"roles":["depths","surface","sky","orbit"],"title":"ACBench re-score: four-plane authored policies, 45 min wall clock, opencode 1.19.5; novice/standard/veteran/elite/champion bots both sides on crossfire, twin_fords, crown × 1 seed(s)","track":"authored-policy","blocks":[{"blockId":"crossfire-seed-5101","stratumId":"crossfire","scenarioId":"crossfire-seed-5101"},{"blockId":"twin_fords-seed-5101","stratumId":"twin_fords","scenarioId":"twin_fords-seed-5101"},{"blockId":"crown-seed-5101","stratumId":"crown","scenarioId":"crown-seed-5101"}],"digest":"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c","strata":[{"id":"crossfire","weight":1},{"id":"twin_fords","weight":1},{"id":"crown","weight":1}],"harness":{"id":"opencode","version":"1.19.5"},"scoring":{"method":"weighted-score/1","timeout":"draw","authoringFailure":"zero"},"version":1,"authoring":{"budgets":{"maxTurns":20000,"maxTokens":200000000,"maxCostUsd":"10"},"maxWallMs":2700000,"replicates":2,"practiceSeeds":[17,29]},"evaluation":{"repetitions":1,"permutations":["novice-nw","novice-se","standard-nw","standard-se","veteran-nw","veteran-se","elite-nw","elite-se","champion-nw","champion-se"]},"references":[{"id":"novice","digest":"da555df45a2fee0457c16c2846c788bfc58fd69417103f171b5570be1b9bb8fd"},{"id":"standard","digest":"043f62745696ead3341490c9a74d02747d1764ac2d448d37cdab9a9e75deac36"},{"id":"veteran","digest":"5ee97857e5a647d38c10ee781f3d16b707cc7201df185a8777e589a6cee7af1f"},{"id":"elite","digest":"288b785872251ea06d68d018d3fb58c75d6850ca7b13de3f7ef9ae7b28c5e2b6"},{"id":"champion","digest":"c7ab19194d52945b388b5ba554c605cf0dba49c44eec12b0fbc33a2d66cd7ac1"}],"gameVersion":"0.1.0","surfaceHash":"c62c6556b9f21ab26e1be42dd0161dc58f2048d86cb2efc6a62512522560dca8","uncertainty":{"seed":1729,"method":"crossed-run-block-bootstrap/1","replicates":2000},"seriesDigest":"e2d9fc69cd48f557fa195e997c29b3acf7e23981c3d01280db3874d207138a9a"},"digest":"00cbce1bd6d579658324046eb6979aba175d0e79043c820b7436764e21ae8ca2","format":"playerthree.benchmark-publication","consent":{"license":"CC-BY-4.0","results":true,"research":true,"training":false,"artifacts":false,"attribution":true},"version":1,"revision":1,"retention":{"policy":"until-withdrawn","withdrawalNotice":"Downloaded copies cannot be recalled."},"experiment":{"id":"deepseek-v4.1-flash","digest":"adfa8cc4f947353619dd9cd188979b31be307f74ee2409da438d1c38604214a4","system":{"id":"deepseek-v4.1-flash","label":"deepseek-v4.1-flash (via OpenRouter)","model":"deepseek/deepseek-v4.1-flash-1017","harness":"opencode/1.19.5","provider":"openai","configurationDigest":"89dd9de8d345effb188f5db528bfd9331526f819b3468d0cfa423219ac9fe3d3"},"provenance":"runner-observed","replicates":2,"suiteDigest":"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c","executionDigest":"d740a12cb7938253a7029287e6583d328a3998f708235b05cf7019a7f3065342"},"publishedAt":"2026-11-14T23:37:52.403Z"},"releaseId":"acbench-v0-1","releaseRevision":1,"publisher":"community","evidence":"runner-observed","releasedAt":"2026-11-14T23:38:19.698Z","correction":null,"supersedes":null},{"publication":{"id":"publication-e78b58e269267e44cd1c8f935c0a0dc2","runs":[{"id":"run-1","cost":{"scope":"authoring-run","amount":"2.735950400000","source":"router-reported","coverage":"complete","currency":"USD","pricedAt":"2026-11-13T03:30:00.000Z","pricingVersion":"openrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts"},"index":0,"reason":"cutoff","status":"evaluated","trials":[{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-0","attempts":1,"stratumId":"crossfire","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-1","attempts":1,"stratumId":"crossfire","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-2","attempts":1,"stratumId":"crossfire","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-3","attempts":1,"stratumId":"crossfire","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-4","attempts":1,"stratumId":"crossfire","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-5","attempts":1,"stratumId":"crossfire","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-6","attempts":1,"stratumId":"crossfire","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-7","attempts":1,"stratumId":"crossfire","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-8","attempts":1,"stratumId":"crossfire","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-9","attempts":1,"stratumId":"crossfire","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-10","attempts":1,"stratumId":"twin_fords","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-11","attempts":1,"stratumId":"twin_fords","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-12","attempts":1,"stratumId":"twin_fords","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-13","attempts":1,"stratumId":"twin_fords","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-14","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-15","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-16","attempts":1,"stratumId":"twin_fords","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-17","attempts":1,"stratumId":"twin_fords","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-18","attempts":1,"stratumId":"twin_fords","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-19","attempts":1,"stratumId":"twin_fords","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-20","attempts":1,"stratumId":"crown","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-21","attempts":1,"stratumId":"crown","permutationId":"novice-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-22","attempts":1,"stratumId":"crown","permutationId":"standard-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-23","attempts":1,"stratumId":"crown","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-24","attempts":1,"stratumId":"crown","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-25","attempts":1,"stratumId":"crown","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-26","attempts":1,"stratumId":"crown","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-27","attempts":1,"stratumId":"crown","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-28","attempts":1,"stratumId":"crown","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-29","attempts":1,"stratumId":"crown","permutationId":"champion-se"}],"seriesId":"6b079df6-d750-4e58-9a44-b53e5e60a800","startedAt":"2026-11-13T21:01:27.786Z","finishedAt":"2026-11-14T22:58:20.713Z","artifactDigest":"eb491d0426acb93570b438e235e2e6efbcfea21d2a1fed4a6bc6a99d489e43ba","seriesRevision":62,"authoringAttempts":2},{"id":"run-2","cost":{"scope":"authoring-run","amount":"2.051252100000","source":"router-reported","coverage":"complete","currency":"USD","pricedAt":"2026-11-13T03:30:00.000Z","pricingVersion":"openrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts"},"index":1,"reason":"cutoff","status":"evaluated","trials":[{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-0","attempts":1,"stratumId":"crossfire","permutationId":"novice-nw"},{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-1","attempts":1,"stratumId":"crossfire","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-2","attempts":1,"stratumId":"crossfire","permutationId":"standard-nw"},{"score":1,"status":"win","blockId":"crossfire-seed-5101","trialId":"trial-3","attempts":1,"stratumId":"crossfire","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-4","attempts":1,"stratumId":"crossfire","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-5","attempts":1,"stratumId":"crossfire","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-6","attempts":1,"stratumId":"crossfire","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-7","attempts":1,"stratumId":"crossfire","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-8","attempts":1,"stratumId":"crossfire","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crossfire-seed-5101","trialId":"trial-9","attempts":1,"stratumId":"crossfire","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-10","attempts":1,"stratumId":"twin_fords","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-11","attempts":1,"stratumId":"twin_fords","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-12","attempts":1,"stratumId":"twin_fords","permutationId":"standard-nw"},{"score":1,"status":"win","blockId":"twin_fords-seed-5101","trialId":"trial-13","attempts":1,"stratumId":"twin_fords","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-14","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-15","attempts":1,"stratumId":"twin_fords","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-16","attempts":1,"stratumId":"twin_fords","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-17","attempts":1,"stratumId":"twin_fords","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-18","attempts":1,"stratumId":"twin_fords","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"twin_fords-seed-5101","trialId":"trial-19","attempts":1,"stratumId":"twin_fords","permutationId":"champion-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-20","attempts":1,"stratumId":"crown","permutationId":"novice-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-21","attempts":1,"stratumId":"crown","permutationId":"novice-se"},{"score":1,"status":"win","blockId":"crown-seed-5101","trialId":"trial-22","attempts":1,"stratumId":"crown","permutationId":"standard-nw"},{"score":1,"status":"win","blockId":"crown-seed-5101","trialId":"trial-23","attempts":1,"stratumId":"crown","permutationId":"standard-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-24","attempts":1,"stratumId":"crown","permutationId":"veteran-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-25","attempts":1,"stratumId":"crown","permutationId":"veteran-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-26","attempts":1,"stratumId":"crown","permutationId":"elite-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-27","attempts":1,"stratumId":"crown","permutationId":"elite-se"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-28","attempts":1,"stratumId":"crown","permutationId":"champion-nw"},{"score":0,"status":"loss","blockId":"crown-seed-5101","trialId":"trial-29","attempts":1,"stratumId":"crown","permutationId":"champion-se"}],"seriesId":"243b64a8-7022-456a-93fb-4befce73affe","startedAt":"2026-11-13T22:12:24.525Z","finishedAt":"2026-11-14T23:36:33.669Z","artifactDigest":"87f05cc005157e5400c5d0d4fe83eac4bf63bee07a54288f31c4dcc7d9127fcc","seriesRevision":62,"authoringAttempts":1}],"score":{"value":0.13333333333333333,"complete":true,"interval":[0,0.26666666666666666],"runScores":[0,0.26666666666666666],"failedRuns":0,"uncertainty":{"runs":2,"seed":1729,"blocks":3,"method":"crossed-run-block-bootstrap/1","replicates":2000},"expectedRuns":2,"scoredTrials":60,"completedRuns":2,"expectedTrials":60},"suite":{"id":"acbench-v1-ed46598e332a","game":"agent-command","build":{"gameDigest":"7374d9bdb99cb98f2979cc79217f019c04fe806bc92f7a9da2ecfbc15f05a4ff","runnerDigest":"eb01d29a12a07facf6b5868607f5e80f1d7fabd3595efac9d42301668d7042e3"},"roles":["depths","surface","sky","orbit"],"title":"ACBench re-score: four-plane authored policies, 45 min wall clock, opencode 1.19.5; novice/standard/veteran/elite/champion bots both sides on crossfire, twin_fords, crown × 1 seed(s)","track":"authored-policy","blocks":[{"blockId":"crossfire-seed-5101","stratumId":"crossfire","scenarioId":"crossfire-seed-5101"},{"blockId":"twin_fords-seed-5101","stratumId":"twin_fords","scenarioId":"twin_fords-seed-5101"},{"blockId":"crown-seed-5101","stratumId":"crown","scenarioId":"crown-seed-5101"}],"digest":"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c","strata":[{"id":"crossfire","weight":1},{"id":"twin_fords","weight":1},{"id":"crown","weight":1}],"harness":{"id":"opencode","version":"1.19.5"},"scoring":{"method":"weighted-score/1","timeout":"draw","authoringFailure":"zero"},"version":1,"authoring":{"budgets":{"maxTurns":20000,"maxTokens":200000000,"maxCostUsd":"10"},"maxWallMs":2700000,"replicates":2,"practiceSeeds":[17,29]},"evaluation":{"repetitions":1,"permutations":["novice-nw","novice-se","standard-nw","standard-se","veteran-nw","veteran-se","elite-nw","elite-se","champion-nw","champion-se"]},"references":[{"id":"novice","digest":"da555df45a2fee0457c16c2846c788bfc58fd69417103f171b5570be1b9bb8fd"},{"id":"standard","digest":"043f62745696ead3341490c9a74d02747d1764ac2d448d37cdab9a9e75deac36"},{"id":"veteran","digest":"5ee97857e5a647d38c10ee781f3d16b707cc7201df185a8777e589a6cee7af1f"},{"id":"elite","digest":"288b785872251ea06d68d018d3fb58c75d6850ca7b13de3f7ef9ae7b28c5e2b6"},{"id":"champion","digest":"c7ab19194d52945b388b5ba554c605cf0dba49c44eec12b0fbc33a2d66cd7ac1"}],"gameVersion":"0.1.0","surfaceHash":"c62c6556b9f21ab26e1be42dd0161dc58f2048d86cb2efc6a62512522560dca8","uncertainty":{"seed":1729,"method":"crossed-run-block-bootstrap/1","replicates":2000},"seriesDigest":"e2d9fc69cd48f557fa195e997c29b3acf7e23981c3d01280db3874d207138a9a"},"digest":"5bdbe734b78d2d4b3df69ef0681634e62c0948ed2868692fcc0d35e507261248","format":"playerthree.benchmark-publication","consent":{"license":"CC-BY-4.0","results":true,"research":true,"training":false,"artifacts":false,"attribution":true},"version":1,"revision":1,"retention":{"policy":"until-withdrawn","withdrawalNotice":"Downloaded copies cannot be recalled."},"experiment":{"id":"gpt-6.1-sol","digest":"c6d1d0488b5b5445f276afbb70bde1be31dc8086c4d72b432c6c46b089c4689c","system":{"id":"gpt-6.1-sol","label":"gpt-6.1-sol (via OpenRouter)","model":"openai/gpt-6.1-sol","harness":"opencode/1.19.5","provider":"openai","configurationDigest":"d748a6577e82b8f4de98dd470a5cf80eb4bad39f0e49f06c14286b3f2f62139c"},"provenance":"runner-observed","replicates":2,"suiteDigest":"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c","executionDigest":"b57972abd740a749223c25faa1d05bbf09825625ce80239fbc31d72ff89b3208"},"publishedAt":"2026-11-14T23:37:53.623Z"},"releaseId":"acbench-v0-1","releaseRevision":1,"publisher":"community","evidence":"runner-observed","releasedAt":"2026-11-14T23:38:19.698Z","correction":null,"supersedes":null}],"release":{"id":"acbench-v0-1","revision":1,"title":"ACBench v0.1","path":"/benchmarks/community/acbench-v0-1/1/","publisher":"community","evidence":"runner-observed","publishedAt":"2026-11-14T23:38:19.698Z","notBefore":"2026-11-14T23:38:19.698Z","digest":"f90e07425383f91c3bcb58e64fe49aa745555f60c9b96c7eb2599ebf4a2b1a1e","systems":3,"correction":null,"previous":null},"initialCohort":"[\"9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c\",\"d748a6577e82b8f4de98dd470a5cf80eb4bad39f0e49f06c14286b3f2f62139c\"]","initialModel":"","replacement":null,"headline":null},"assets":{"script":"/assets/benchmarks-DD54ELMw.js","styles":["/assets/benchmarks-BSg68Sdm.css"],"brand":{"logo":"/assets/logo-DtU69aqb.webp","icon":"/assets/icon-3g0TSaEV.png","touchIcon":"/assets/apple-touch-icon-bEP3EESm.png","font":"/assets/bangers-latin-400-normal-DeHY8Ncq.woff2"}}}