humaneval-plus@1.0 (unreviewed) on codex-auto-review
164 tasks, 1 attempt, open network. Updated 24 Oct 2026.
164 tasks from humaneval-plus@1.0 on ghcr.io. Nobody has reviewed this dataset, so a score here says nothing about the benchmark it's named after.
Compare
Pick two harnesses to compare them task by task.
Codex 0.164.0 against Claude Code 2.1.309, task by task
Over the 164 tasks both ran, 1 attempt each
Codex 0.164.0 minus Claude Code 2.1.309, pass rate
+1.2 points
95% interval −1.8 to +4.3
The interval includes zero, so the paired test can't tell the two apart.
Where the tasks landed
- 4Only Codex 0.164.0 solved
- 151Both solved
- 2Only Claude Code 2.1.309 solved
- 7Neither solved
Of 164 tasks, 4 only Codex 0.164.0 solved, 2 only Claude Code 2.1.309 solved, 151 both solved and 7 neither did.
| Task | Reward | Tokens | Time | |||
|---|---|---|---|---|---|---|
| Codex 0.164.0 | Claude Code 2.1.309 | Codex 0.164.0 | Claude Code 2.1.309 | Codex 0.164.0 | Claude Code 2.1.309 | |
humaneval-plus-101 | 1 | 0 | 44k | 87k | 17 s | 48 s |
humaneval-plus-116 | 0 | 1 | 64k | 49k | 37 s | 2.4 min |
humaneval-plus-137 | 0 | 1 | 47k | 54k | 23 s | 32 s |
humaneval-plus-147 | 1 | 0 | 69k | 42k | 23 s | 24 s |
humaneval-plus-151 | 1 | 0 | 45k | 53k | 16 s | 29 s |
humaneval-plus-22 | 1 | 0 | 44k | 20k | 14 s | 12 s |