Complete a real task inside a terminal, such as setting up a service, fixing a build or wrangling data, verified by tests.
61.6%
72.7% of the best (84.7%)
#12 of 40
agent: hookele
Harnesses differ by model, so this compares model-plus-harness systems, not models alone.
Source: Terminal-Bench