Terminal-Bench 2.0
Terminal-Bench is a joint project between Stanford University and Laude Institute. The original benchmark passed 1,000 GitHub stars and drew contributions from nearly 100 developers worldwide before the 2.0 release raised the bar with 89 carefully curated tasks designed to keep frontier-model performance under
the 50% ceiling.
Each task runs in a unique Docker container with a human-written oracle solution and tests that verify the final container state. The 2.0 release dropped easier tasks (like the original "Hello World" debugger), eliminated unreproducible items (like the YouTube-download task affected by changing anti-bot protections), and tightened specifications so that near-100% performance is attainable for sufficiently capable agents.
Leaderboard
| Rank | Agent | Model | Date | Agent Org | Model Org | Accuracy |
|---|
How tight is the top 10?
Each entry on Terminal-Bench is reported with a 95% confidence interval. Visualized on a single axis, the top 10 windows overlap heavily — the rank order is real, but the gaps are smaller than they look.
Methodology
Submissions pair a backbone model with an agent scaffold (Codex CLI, Terminus 2, Mini-SWE-Agent, Claude Code, and others). Each Agent + Model combination is its own leaderboard row.
From the blog
Acknowledgments
Led by Stanford University and Laude Institute, with contributions from a community of nearly 100 developers including Snorkel AI as one of the top external contributors. Snorkel's team contributed in three areas: a systematic difficulty assessment applied across all contributed tasks, an extended failure-mode analysis with traces collected from frontier models, and tasks added to the registry.
