humaneval-plus@1.0 (unreviewed) on GPT-6 Astra
164 tasks, 1 attempt, open network. Updated 24 Oct 2026.
164 tasks from humaneval-plus@1.0 on ghcr.io. Nobody has reviewed this dataset, so a score here says nothing about the benchmark it's named after.
Compare
Pick two harnesses to compare them task by task.
Codex 0.164.0 against Claude Code 2.1.309, task by task
Over the 164 tasks both ran, 1 attempt each
Codex 0.164.0 minus Claude Code 2.1.309, pass rate
−0.6 points
95% interval −1.8 to 0.0
The interval includes zero, so the paired test can't tell the two apart.
Where the tasks landed
- 0Only Codex 0.164.0 solved
- 157Both solved
- 1Only Claude Code 2.1.309 solved
- 6Neither solved
Of 164 tasks, 0 only Codex 0.164.0 solved, 1 only Claude Code 2.1.309 solved, 157 both solved and 6 neither did.
| Task | Reward | Tokens | Time | |||
|---|---|---|---|---|---|---|
| Codex 0.164.0 | Claude Code 2.1.309 | Codex 0.164.0 | Claude Code 2.1.309 | Codex 0.164.0 | Claude Code 2.1.309 | |
humaneval-plus-116 | 0 | 1 | 56k | 41k | 29 s | 31 s |