community · runner-observed · revision 1

DeepSeek V4.1 Flash

via OpenRouter

Release Versioned evidence JSON Manifest

Fixed-reference score: 6.7
Independent runs: 2 / 2
Scored games: 60 / 60
Mean authoring cost: $0.07

Independent run distribution

Score 0–100 · one bar per declared run, not a confidence interval. Failed authoring remains in the score.

run-10.0
evaluated · cutoff
run-213.3
evaluated · cutoff

Recorded game outcomes

60 recorded trial rows · 60 expected games. Raw counts, not weighted scores.

win: 4
draw: 0
loss: 56
forfeit: 0
timeout: 0
incomplete: 0

Timeouts follow frozen adjudication. Missing games are not draws; incomplete cells are not renormalized.

Run evidence and methods

Fixed-reference scores · 0–100 · descriptive ordering, not a significance test
		Independent runs	Scored / expected games		Evidence
DeepSeek V4.1 Flashdeepseek/deepseek-v4.1-flash-1017 · via OpenRouter	6.70.0–13.3 Complete	2/20 failed · 3 blocks	60/60	$0.07Evaluation compute excluded	community · runner-observedRun evidence

Artifact performance is not model-authorship verification. Requested provider/model metadata does not verify model weights.

Authoring lineage, failures & cost coverage

Every declared run, including failures; score values are not confidence intervals.
Run	Status / failure	Score	Policy SHA-256	Attempts	Cost / coverage / pricing
run-1	evaluatedcutoff	0.0	`8ab7d2dd77ef48dcf9dfba09ec9cefeebc2d1e151e29f09ea86769fbdc6768a2`Series 4d55f5f0-9849-4411-be0b-b9e61090cc76 · revision 62	301 authoring	$0.09authoring-run · complete · router-reportedopenrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts · 2026-11-13T03:30:00.000Z
run-2	evaluatedcutoff	13.3	`b0e4bcd5e8d8eecca366f39cf79a346a01f842532a528b5e5d72ed074cd21cf4`Series 74ce1680-5eb5-4fad-a7bf-007118a77903 · revision 62	301 authoring	$0.04authoring-run · complete · router-reportedopenrouter-catalog/2026-11-13T03:30:00Z+pinned-hosts · 2026-11-13T03:30:00.000Z

Opponent / map strata

Frozen weights; incomplete cells are not renormalized
Stratum	Weight	Win / draw / loss / forfeit / timeout / incomplete
crossfire	1	2 / 0 / 18 / 0 / 0 / 0
twin_fords	1	2 / 0 / 18 / 0 / 0 / 0
crown	1	0 / 0 / 20 / 0 / 0 / 0

Frozen methods, hashes & attribution

Suite: acbench-v1-ed46598e332a 1
Game patch: 0.1.0
Controlled roles: depths, surface, sky, orbit
Model (requested / declared): deepseek/deepseek-v4.1-flash-1017
Provider: openai
Fixed harness: opencode/1.19.5
Provenance: runner-observed
Publication SHA-256: 00cbce1bd6d579658324046eb6979aba175d0e79043c820b7436764e21ae8ca2
Suite SHA-256: 9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c
Configuration SHA-256: 89dd9de8d345effb188f5db528bfd9331526f819b3468d0cfa423219ac9fe3d3
Released: 2026-11-14T23:38:19.698Z
License: CC-BY-4.0

Aggregate method: crossed-run-block-bootstrap/1, 2000 bootstrap replicates, seed 1729.

{
  "id": "acbench-v1-ed46598e332a",
  "game": "agent-command",
  "build": {
    "gameDigest": "7374d9bdb99cb98f2979cc79217f019c04fe806bc92f7a9da2ecfbc15f05a4ff",
    "runnerDigest": "eb01d29a12a07facf6b5868607f5e80f1d7fabd3595efac9d42301668d7042e3"
  },
  "roles": [
    "depths",
    "surface",
    "sky",
    "orbit"
  ],
  "title": "ACBench re-score: four-plane authored policies, 45 min wall clock, opencode 1.19.5; novice/standard/veteran/elite/champion bots both sides on crossfire, twin_fords, crown × 1 seed(s)",
  "track": "authored-policy",
  "blocks": [
    {
      "blockId": "crossfire-seed-5101",
      "stratumId": "crossfire",
      "scenarioId": "crossfire-seed-5101"
    },
    {
      "blockId": "twin_fords-seed-5101",
      "stratumId": "twin_fords",
      "scenarioId": "twin_fords-seed-5101"
    },
    {
      "blockId": "crown-seed-5101",
      "stratumId": "crown",
      "scenarioId": "crown-seed-5101"
    }
  ],
  "digest": "9e7ab25c84cac9e28bd1d5b4cb1809ffe216ef656cf6e109277bf00d8bcf589c",
  "strata": [
    {
      "id": "crossfire",
      "weight": 1
    },
    {
      "id": "twin_fords",
      "weight": 1
    },
    {
      "id": "crown",
      "weight": 1
    }
  ],
  "harness": {
    "id": "opencode",
    "version": "1.19.5"
  },
  "scoring": {
    "method": "weighted-score/1",
    "timeout": "draw",
    "authoringFailure": "zero"
  },
  "version": 1,
  "authoring": {
    "budgets": {
      "maxTurns": 20000,
      "maxTokens": 200000000,
      "maxCostUsd": "10"
    },
    "maxWallMs": 2700000,
    "replicates": 2,
    "practiceSeeds": [
      17,
      29
    ]
  },
  "evaluation": {
    "repetitions": 1,
    "permutations": [
      "novice-nw",
      "novice-se",
      "standard-nw",
      "standard-se",
      "veteran-nw",
      "veteran-se",
      "elite-nw",
      "elite-se",
      "champion-nw",
      "champion-se"
    ]
  },
  "references": [
    {
      "id": "novice",
      "digest": "da555df45a2fee0457c16c2846c788bfc58fd69417103f171b5570be1b9bb8fd"
    },
    {
      "id": "standard",
      "digest": "043f62745696ead3341490c9a74d02747d1764ac2d448d37cdab9a9e75deac36"
    },
    {
      "id": "veteran",
      "digest": "5ee97857e5a647d38c10ee781f3d16b707cc7201df185a8777e589a6cee7af1f"
    },
    {
      "id": "elite",
      "digest": "288b785872251ea06d68d018d3fb58c75d6850ca7b13de3f7ef9ae7b28c5e2b6"
    },
    {
      "id": "champion",
      "digest": "c7ab19194d52945b388b5ba554c605cf0dba49c44eec12b0fbc33a2d66cd7ac1"
    }
  ],
  "gameVersion": "0.1.0",
  "surfaceHash": "c62c6556b9f21ab26e1be42dd0161dc58f2048d86cb2efc6a62512522560dca8",
  "uncertainty": {
    "seed": 1729,
    "method": "crossed-run-block-bootstrap/1",
    "replicates": 2000
  },
  "seriesDigest": "e2d9fc69cd48f557fa195e997c29b3acf7e23981c3d01280db3874d207138a9a"
}

Cite this revision

ACBench. deepseek-v4.1-flash (via OpenRouter). acbench-v1-ed46598e332a 1. Publication publication-004d85c66ca2eea1e6ffcac521260058, revision 1. SHA-256 00cbce1bd6d579658324046eb6979aba175d0e79043c820b7436764e21ae8ca2.

Retention: until withdrawn. Downloaded copies cannot be recalled. Raw timeline, source and private transcripts are not included in this public projection.