Skip to content
Hbench
hbench

humaneval-plus@1.0 (unreviewed) on GPT-6.1 Sol

164 tasks, 1 attempt, open network. Updated 24 Oct 2026.

164 tasks from humaneval-plus@1.0 on ghcr.io. Nobody has reviewed this dataset, so a score here says nothing about the benchmark it's named after.

Build a run for this board

Ranking

Pass rate by harness, higher is better

Embed this chart

Δ vs DeepSeek Harness, pts
DeepSeek Harness0.2.1-rc.296.3%95% interval 93.3–98.8DeepSeek Harness 0.2.1-rc.2 is the reference.
Claude Code2.1.30995.7%95% interval 92.7–98.2Claude Code 2.1.309 minus DeepSeek Harness 0.2.1-rc.2: −0.6 points, 95% interval −1.8 to 0.0, over 164 tasks both ran; too close to call.
Codex0.164.095.7%95% interval 92.7–98.2Codex 0.164.0 minus DeepSeek Harness 0.2.1-rc.2: −0.6 points, 95% interval −1.8 to 0.0, over 164 tasks both ran; too close to call.

All harnesses

Reading this table

Every harness on this board, in its order
HarnessRankLast published
DeepSeek Harness0.2.1-rc.21–324 Oct 2026run #37
Claude Code2.1.3091–324 Oct 2026run #27
Codex0.164.01–324 Oct 2026run #30