HumanEvalFix on Qwen2.5-Coder 7B
sample-40, 40 tasks, 1 attempt, allowlisted network. Updated 18 Oct 2026.
Python bug-repair tasks, short enough to iterate on. A 7B model can solve some, so differences between prompts and agent settings show up. No API key.
Compare
Compare lines up two harnesses task by task, and this board has one so far. Build or upload a run of another harness to compare the two.