Terminal-Bench 2.0 on GPT-5.3-Codex
89 tasks, 5 attempts, open network. Updated 25 Oct 2026.
Value
What a task cost each configuration.
$ per solved task
Lower is cheaper. Dollars per task divided by the pass rate.
Harness$ per solved task
Tokens per task
Lower is leaner. Input plus output, cached input included.
HarnessTokens per task
Agent time per task
Lower is faster. Agent start to finish; setup and tests left out.
HarnessTime per task
Pass rate against tokens per task
Up and to the left is better. Not offered: dollars, which fewer than two rows report. Pass-rate axis starts at 60%.
- On the frontier: no other row has a higher pass rate for less tokens
- Off the frontier
- 95% interval of the pass rate