SWE-Bench Pro
64.3
resolve rate
Terminal-Bench
66.1
success rate
SWE-Atlas Refactoring
48.57
score
Artificial Analysis Coding Agent Index
66.6
average pass@1
SWE-Atlas Codebase QnA
81
pass@1
Artificial Analysis Coding Agent Index
61.2
average pass@1
SWE-Atlas Codebase QnA
78.4
pass@1
Artificial Analysis Coding Agent Index
59.9
average pass@1
SWE-Atlas Codebase QnA
71.7
pass@1