artificialanalysis.ai · benchmark source
Artificial Analysis
Independent evaluations across composite intelligence, hard reasoning, science reasoning, and agentic terminal tasks. Multiple boards live under one publisher.
Expert reasoning
Humanity's Last Exam
Extremely hard expert-written questions across 100+ subjects, designed as a frontier-knowledge ceiling. Artificial Analysis runs the 2,158 text-only questions without tools.
Why it matters
It still separates frontier models now that GPQA Diamond has saturated near 96%.
Use it when
You need a hard-reasoning signal that is not yet saturated.
The limitation
No-tools scores here are much lower than the 'with tools' HLE figures vendors quote at launch — the two setups are not comparable. Knowledge questions are not coding or agent work.
Leaderboard snapshot
Humanity's Last Exam results in a readable view
Use the tabs for the primary score and other published fields from this board. The source link remains authoritative for the live table.
Leader among verified rows
Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)
61.4%
Rows shown
3
Accuracy
Source / snapshot date
2026-10-01
25 days old · not a live API feed
Score profile
Accuracy by published row
Higher is better in this view
Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback)| Rank | Model or system | Accuracy | Other details | Note |
|---|---|---|---|---|
| #1 | Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic | 61.4% | View: Artificial AnalysisSetup: Text-only, no tools (AA) | — Source captured 2026-10-01 · Publisher/run date not disclosed |
| #2 | Claude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)Anthropic | 59.1% | View: Artificial AnalysisSetup: Text-only, no tools (AA) | — Source captured 2026-10-01 · Publisher/run date not disclosed |
| #3 | Claude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback)Anthropic | 58.7% | View: Artificial AnalysisSetup: Text-only, no tools (AA) | — Source captured 2026-10-01 · Publisher/run date not disclosed |
Question set
2,158 text-only questions (Artificial Analysis run)
Setup
No tools — lower than vendor 'with tools' claims
Why it matters
Unsaturated hard-reasoning signal now that GPQA Diamond sits near its ceiling
Only three exact public AA headline configurations are retained. This is the AA text-only, no-tools run; vendor tool-enabled results are a different setup. The full component data require publisher access. 3 exact matching primary-source observations are ranked in this retained subset. 631 unsupported observations are excluded from ranks, charts and leader claims. Subset ranks are not positions on the complete publisher leaderboard. Exact retained receipts captured 2026-10-01; source/run dates are shown per verified row when known.
Not yet verified (631)
No exact matching primary-source observation was retained for these entries. Scores are withheld here; these entries do not affect ranks, leaders, charts or search indexing.
- Claude Opus 5.5 (Adaptive Reasoning, Xhigh Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5.1 (Adaptive Reasoning, High Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5.5 (Adaptive Reasoning, High Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5.5 (Adaptive Reasoning, Medium Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (max)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5.1 (Adaptive Reasoning, Medium Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (high)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, High Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Medium Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (max)
No exact matching primary-source row was retained; excluded from rankings.
- MiMo-V2.6-Pro
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Astra (low)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Fable 5.1 (Adaptive Reasoning, Low Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 4.8 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.3 (max)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5.5 (Adaptive Reasoning, Low Effort, Default Fallback)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.7 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Sol (max)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.8 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.3 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.1 Pro Preview
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K3 (max)
No exact matching primary-source row was retained; excluded from rankings.
- Step 5 Preview
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Sol (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.1 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark 1.2 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Sol (high)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.4 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 5 (Adaptive Reasoning, Low Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.7 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 Max (0902)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 Max
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (max)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (high)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.5 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.5 (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.3 Codex (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.5 (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8 2.4T A95B
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 4.7 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GLM-5.3 (max)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.7 (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.8 Flash (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.6 (medium)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Sonnet 5 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.5 Flash (medium)
No exact matching primary-source row was retained; excluded from rankings.
- GLM-5.2 (max)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Pro 0813 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Sol (medium)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.6 Flash (high)
No exact matching primary-source row was retained; excluded from rankings.
- Muse Spark
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.7 Max
No exact matching primary-source row was retained; excluded from rankings.
- Motif 3 (Beta)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Opus 4.6 (Adaptive Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GLM 5.3 Flash
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3 Pro Preview (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Luna (max)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Sol (low)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4.1 Flash (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Sonnet 5 (Adaptive Reasoning, Xhigh Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.7 Flash (medium)
No exact matching primary-source row was retained; excluded from rankings.
- MiniMax-M3
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Flash 0731 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Terra (high)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Luna (max)
No exact matching primary-source row was retained; excluded from rankings.
- Grok Build 0.1 0616
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.8-Flash-Next
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.2 (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Pro 0424 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K2.6
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.3 (high)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.8 Flash (low)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.6 Luna (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- Motif 3
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3 Flash Preview (Reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- GLM-5.3 (low)
No exact matching primary-source row was retained; excluded from rankings.
- Claude Sonnet 5 (Adaptive Reasoning, High Effort)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-5.2 Codex (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
- MiMo-V2.5-Pro
No exact matching primary-source row was retained; excluded from rankings.
- Qwen3.7 Plus
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Pro 0424 (Reasoning, High Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Gemini 3.7 Flash (low)
No exact matching primary-source row was retained; excluded from rankings.
- Kimi K2.7 Code
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Sol (low)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Flash 0420 (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- DeepSeek V4 Flash Vision (Reasoning, Max Effort)
No exact matching primary-source row was retained; excluded from rankings.
- Grok 4.20 0309 v2 (Reasoning)
No exact matching primary-source row was retained; excluded from rankings.
- GPT-6 Luna (xhigh)
No exact matching primary-source row was retained; excluded from rankings.
Showing 100 entries. Open the publisher source for the current complete table.
Only three exact public AA headline configurations are retained. This is the AA text-only, no-tools run; vendor tool-enabled results are a different setup. The full component data require publisher access. 3 exact matching primary-source observations are ranked in this retained subset. 631 unsupported observations are excluded from ranks, charts and leader claims. Subset ranks are not positions on the complete publisher leaderboard. Exact retained receipts captured 2026-10-01; source/run dates are shown per verified row when known.
Open Artificial Analysis Humanity's Last ExamEvidence in this catalog
Where Humanity's Last Exam fits
Closest verified examples we currently carry. A missing score is not a zero.
Model examples
Published source observation captured 2026-10-01. Source-specific result; no independent rerun or universal capability verdict.
Published source observation captured 2026-10-01. Source-specific result; no independent rerun or universal capability verdict.
Published source observation captured 2026-10-01. Source-specific result; no independent rerun or universal capability verdict.
Harness examples
No directly comparable harness score is verified here yet.