Terminal-Bench 2.0 on qwen3.5-9b
89 tasks, 5 attempts, open network. Updated 25 Oct 2026.
Value
What a task cost each configuration.
$ per solved task
Lower is cheaper. Dollars per task divided by the pass rate.
Tokens per task
Lower is leaner. Input plus output, cached input included.
Agent time per task
Lower is faster. Agent start to finish; setup and tests left out.
HarnessTime per task
Pass rate against tokens per task
Up and to the left is better.
The frontier needs two configurations that report tokens, time or dollars.