SWE-bench Verified
swebench-verified@1.0500 real GitHub issues, each resolved against its project's own test suite. Scores this high on a public set may reflect contamination, so read them as harness differences on one model.
How SWE-bench Verified measures up to the dataset checklist
Boards
Every board here runs on an allowlisted network.
| Model | Highest pass rate | Attempts | Harnesses | Updated |
|---|---|---|---|---|
| Claude Opus 5.5 | 1 | 2 | 19 Oct 2026 |