HumanEvalFix on Qwen2.5-Coder 7B
sample-40, 40 tasks, 1 attempt, allowlisted network. Updated 18 Oct 2026.
Python bug-repair tasks, short enough to iterate on. A 7B model can solve some, so differences between prompts and agent settings show up. No API key.
Runs
Every published run on this board, each with its own pass rate over the board's tasks, beside its configuration's pooled score.
Every run's pass rate
Pass rate, higher is better.
HarnessRuns, 0 to 100%PooledRuns