artificialanalysis.ai · benchmark source
Artificial Analysis
Independent evaluations across composite intelligence, hard reasoning, science reasoning, and agentic terminal tasks. Multiple boards live under one publisher.
Tool use
Terminal-Bench 2.1 (archive)
A terminal-oriented evaluation of agents that must use shell tools and complete multi-step tasks in an environment.
Why it matters
It tests the loop around a model: planning, commands, file changes, and validation.
Use it when
You are reproducing older 2.1 results; for current terminal-agent comparisons use the Terminal-Bench 4.0 board.
The limitation
Superseded: Terminal-Bench 3.0 (Jul 2026) and 4.0 (Aug 2026) replaced the task set, so 2.1 scores are not comparable with them. A high score does not guarantee safe behaviour in your repository. Rows here use Artificial Analysis Terminus 2; proprietary agent harnesses on tbench.ai are separate.
Leaderboard snapshot
Terminal-Bench 2.1 (archive) results in a readable view
Use the tabs for the primary score and other published fields from this board. The source link remains authoritative for the live table.
Leader among verified rows
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)
91.4%
Rows shown
3
Success rate
Source / snapshot date
2026-10-01
25 days old · not a live API feed
Score profile
Success rate · Artificial Analysis Terminus 2
Higher is better in this view
Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback)Claude Fable 5.1 (Adaptive Reasoning, High Effort, Default Fallback)| Rank | Model or system | Success rate | Other details | Note |
|---|---|---|---|---|
| #1 | Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)AnthropicArtificial Analysis Terminus 2 | 91.4% | View: Artificial AnalysisHarness: Terminus 2 (Artificial Analysis) | — Source captured 2026-10-01 · Publisher/run date not disclosed |
| #2 | Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback)AnthropicArtificial Analysis Terminus 2 | 91% | View: Artificial AnalysisHarness: Terminus 2 (Artificial Analysis) | — Source captured 2026-10-01 · Publisher/run date not disclosed |
| #3 | Claude Fable 5.1 (Adaptive Reasoning, High Effort, Default Fallback)AnthropicArtificial Analysis Terminus 2 | 89.9% | View: Artificial AnalysisHarness: Terminus 2 (Artificial Analysis) | — Source captured 2026-10-01 · Publisher/run date not disclosed |
Not yet verified (237)
No exact matching primary-source observation was retained for these entries. Scores are withheld here; these entries do not affect ranks, leaders, charts or search indexing.
- GPT-6 Astra (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 Max (0902)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (max)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (high)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5.1 (Adaptive Reasoning, Medium Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (max)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (max)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (low)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, High Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.8 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (high)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Medium Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8-Flash-Next
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.7 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.3 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5.1 (Adaptive Reasoning, Low Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K3 (max)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 4.8 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GLM 5.3 Flash
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.3 (max)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.8 Flash (medium)
No exact matching primary-source row was retained; excluded from rankings.
- GLM-5.3 (max)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 4.7 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.8 Flash (low)
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K3 (low)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 2.4T A95B
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.5 (high)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 Max
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Luna (max)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Sonnet 5 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (medium)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.2 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.7 Flash (low)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 27B (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (high)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Flash 0731 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Pro 0813 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.5 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.7 Flash (medium)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.4 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GLM-5.2 (max)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Luna (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.1 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.6 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (low)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Low Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (high)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Sonnet 5 (Non-reasoning, High Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (low)
No exact matching primary-source row was retained; excluded from rankings.
- Motif 3
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.7 Max
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Flash Vision (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (Non-reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.1 Pro Preview
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (medium)
No exact matching primary-source row was retained; excluded from rankings.
- K2 Horizon 375B A23B
No exact matching primary-source row was retained; excluded from rankings.
- Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Motif 3 (Beta)
No exact matching primary-source row was retained; excluded from rankings.
- KAT Coder Pro V2
No exact matching primary-source row was retained; excluded from rankings.
- Apodex 1.1
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Luna (high)
No exact matching primary-source row was retained; excluded from rankings.
- Quasar 438B (max, based on GLM-5.2)
No exact matching primary-source row was retained; excluded from rankings.
- Nex-N2-Pro (based on Qwen3.5-397B-A17B)
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K2.7 Code
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 27B (low)
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K2.6
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (low)
No exact matching primary-source row was retained; excluded from rankings.
- MiMo-V2.5-Pro
No exact matching primary-source row was retained; excluded from rankings.
- MiniMax-M3
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 27B (medium)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Pro 0424 (Reasoning, High Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Hy3
No exact matching primary-source row was retained; excluded from rankings.
- Ling-3.0-flash-VL
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Pro 0424 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- MiMo-V2.5
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (low)
No exact matching primary-source row was retained; excluded from rankings.
- Ling-3.0-flash-Fin
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Flash 0420 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GLM-5.1 (Reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- MiMo-V2-Flash (Non-reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.6 Plus
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (Non-reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.7 Plus
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.4 nano (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.6 27B (Reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- JT-4.1 Flash 236B A21B
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.4 mini (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Solar Pro 4
No exact matching primary-source row was retained; excluded from rankings.
Showing 100 entries. Open the publisher source for the current complete table.
Archive version: Terminal-Bench 2.1 is superseded by 3.0 and 4.0 and is not comparable across task sets. Only three exact public AA headline configurations are retained; the full component data require publisher access. 3 exact matching primary-source observations are ranked in this retained subset. 237 unsupported observations are excluded from ranks, charts and leader claims. Subset ranks are not positions on the complete publisher leaderboard. Exact retained receipts captured 2026-10-01; source/run dates are shown per verified row when known.
Open Artificial Analysis Terminal-Bench 2.1Evidence in this catalog
Where Terminal-Bench 2.1 (archive) fits
Closest verified examples we currently carry. A missing score is not a zero.
Model examples
Published source observation captured 2026-10-01. Source-specific result; no independent rerun or universal capability verdict.
Published source observation captured 2026-10-01. Source-specific result; no independent rerun or universal capability verdict.
Published source observation captured 2026-10-01. Source-specific result; no independent rerun or universal capability verdict.
Harness examples
- Claude CodeTerminal agent
Terminal-Bench scores models inside a harness loop — compare terminal agents after you narrow the model field.
- CursorIDE agent harness
Use harness comparisons to separate editor workflow from bare API scores on this board.