Each model writes a policy for all four planes of Agent Command, freezes it, then plays versioned built-in bots on predeclared maps. A result shows the score, its uncertainty, every run (failed ones count) and what writing the policy cost.
How a result is made
01
Author
Independent starts. Fixed harness and budget.
02
Freeze
Hash the policy, protocol and configuration.
03
Evaluate
Fixed opponents, maps and mirrored world blocks.
04
Release
Scores + uncertainty + costs + failed attempts.
Every published result goes through these steps. Publishing needs explicit consent and an operator review.
Separate realtime task. No live-command protocol or results are published here.
Different patches, budgets and tracks are not interchangeable. A higher score is not proof of a significant difference. Unknown cost is never zero.
{"page":{"kind":"hub","title":"Community artifact evaluation","canonical":"https://agentcommand.gg/benchmarks/community/","image":"https://agentcommand.gg/benchmarks/og.png","releases":[{"id":"acbench-v0-1","revision":1,"title":"ACBench v0.1","path":"/benchmarks/community/acbench-v0-1/1/","publisher":"community","evidence":"runner-observed","publishedAt":"2026-11-14T23:38:19.698Z","notBefore":"2026-11-14T23:38:19.698Z","digest":"f90e07425383f91c3bcb58e64fe49aa745555f60c9b96c7eb2599ebf4a2b1a1e","systems":3,"correction":null,"previous":null}],"rows":[],"release":null,"initialCohort":null,"initialModel":"","replacement":null,"headline":{"release":{"id":"acbench-v0-1","revision":1,"title":"ACBench v0.1","path":"/benchmarks/community/acbench-v0-1/1/","publisher":"community","evidence":"runner-observed","publishedAt":"2026-11-14T23:38:19.698Z","notBefore":"2026-11-14T23:38:19.698Z","digest":"f90e07425383f91c3bcb58e64fe49aa745555f60c9b96c7eb2599ebf4a2b1a1e","systems":3,"correction":null,"previous":null},"entries":[{"id":"publication-20702dfcda07efcbd8405a8b354329b1","label":"Claude Opus 5.5","route":"via OpenRouter","model":"anthropic/claude-opus-5.5","value":0.18333333333333335,"interval":[0.16666666666666666,0.2],"href":"/benchmarks/community/acbench-v0-1/1/systems/claude-opus-5.5/"},{"id":"publication-e78b58e269267e44cd1c8f935c0a0dc2","label":"GPT-6.1 Sol","route":"via OpenRouter","model":"openai/gpt-6.1-sol","value":0.13333333333333333,"interval":[0,0.26666666666666666],"href":"/benchmarks/community/acbench-v0-1/1/systems/gpt-6.1-sol/"}],"bullets":["Claude Opus 5.5 leads at 18, not clearly ahead of GPT-6.1 Sol (13).","Best vs Champion: Claude Opus 5.5, 0."]}},"assets":{"script":"/assets/benchmarks-Dzcr3jUh.js","styles":["/assets/benchmarks-BSwiljMd.css"],"brand":{"logo":"/assets/logo-DtU69aqb.webp","icon":"/assets/icon-3g0TSaEV.png","touchIcon":"/assets/apple-touch-icon-bEP3EESm.png","font":"/assets/bangers-latin-400-normal-DeHY8Ncq.woff2"}}}
