HumanEvalFix on Qwen2.5-Coder 7B
sample-40, 40 tasks, 1 attempt, allowlisted network. Updated 18 Oct 2026.
Python bug-repair tasks, short enough to iterate on. A 7B model can solve some, so differences between prompts and agent settings show up. No API key.
Ranking
Pass rate by harness, higher is better
All harnesses
| Harness | Runs | Last published |
|---|---|---|
| Terminus 2 | 1issued 3 · uploaded 1 · 1 public | 18 Oct 2026run #15 |