Consensus score
26.7
95% interval 18.5 to 29.9
26.7
95% interval 18.5 to 29.9
30th
IQR spread 11.5 pct
67
Across 6 domains
3
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| METR time horizon METR time horizons · metr_agents/react | #18 / 23Tied #1 | 11.4 min[5.5 min to 22.4 min] | Unknown | Standard | Not stated |
| FrontierMath-2025-02-28-Private Epoch AI Benchmarking Hub · Default | #90 / 101 | 1%[0.3% to 3.2%] | Unknown | Standard | 7 Mar 2025 |
| LMArena Vision (style control) LMArena · Chinese · Default | #113 / 135 | 1,127[1,087 to 1,166] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Chinese · Default | #114 / 135 | 1,105[1,066 to 1,144] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Overall · Default | #121 / 167 | 1,146[1,136 to 1,156] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Overall · Default | #128 / 167 | 1,120[1,110 to 1,130] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · English · Default | #129 / 167 | 1,136[1,123 to 1,149] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · English · Default | #130 / 167 | 1,119[1,106 to 1,132] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #149 / 243 | 1,389[1,319 to 1,458] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #185 / 243 | 1,328[1,260 to 1,396] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #188 / 288 | 1,285[1,269 to 1,302] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #191 / 289 | 1,290[1,270 to 1,310] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #194 / 320 | 1,334[1,318 to 1,349] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #198 / 301 | 1,363[1,339 to 1,387] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #200 / 288 | 1,231[1,215 to 1,247] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #206 / 304 | 1,352[1,330 to 1,375] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #215 / 419 | 1,350[1,342 to 1,357] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #216 / 385 | 1,345[1,337 to 1,354] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #217 / 416 | 1,399[1,392 to 1,406] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #218 / 301 | 1,293[1,270 to 1,317] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #221 / 399 | 1,355[1,348 to 1,363] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #221 / 421 | 1,332[1,328 to 1,337] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #222 / 320 | 1,271[1,256 to 1,286] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #222 / 420 | 1,331[1,325 to 1,337] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #224 / 304 | 1,289[1,267 to 1,312] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #224 / 404 | 1,342[1,335 to 1,350] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #225 / 289 | 1,201[1,181 to 1,220] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #225 / 419 | 1,312[1,304 to 1,319] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #225 / 421 | 1,338[1,333 to 1,343] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #229 / 421 | 1,361[1,356 to 1,367] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #229 / 393 | 1,354[1,343 to 1,365] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #230 / 402 | 1,340[1,332 to 1,348] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #231 / 371 | 1,344[1,333 to 1,356] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #234 / 421 | 1,343[1,340 to 1,347] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #236 / 419 | 1,304[1,297 to 1,312] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #237 / 421 | 1,297[1,292 to 1,302] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #238 / 419 | 1,367[1,361 to 1,374] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #238 / 419 | 1,357[1,349 to 1,364] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #238 / 391 | 1,350[1,338 to 1,361] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #239 / 421 | 1,373[1,367 to 1,379] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #240 / 404 | 1,303[1,296 to 1,311] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #243 / 395 | 1,346[1,337 to 1,356] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #246 / 338 | 54%[48.6% to 59.4%] | Unknown | Standard | 27 Jan 2025 |
| LMArena Text LMArena · Industry mathematical · Default | #248 / 402 | 1,294[1,286 to 1,302] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #250 / 419 | 1,299[1,292 to 1,306] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #251 / 421 | 1,349[1,344 to 1,353] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #251 / 414 | 1,321[1,313 to 1,329] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #252 / 385 | 1,282[1,274 to 1,290] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #258 / 420 | 1,280[1,274 to 1,286] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #259 / 421 | 1,270[1,265 to 1,275] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #260 / 416 | 1,306[1,299 to 1,313] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #261 / 421 | 1,269[1,264 to 1,275] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #263 / 371 | 1,247[1,236 to 1,258] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #265 / 395 | 1,265[1,255 to 1,274] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #266 / 421 | 1,275[1,270 to 1,281] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #272 / 419 | 1,282[1,276 to 1,289] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #274 / 399 | 1,275[1,267 to 1,282] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #275 / 421 | 1,288[1,282 to 1,294] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #276 / 421 | 1,281[1,278 to 1,284] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #277 / 421 | 1,206[1,201 to 1,211] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #280 / 419 | 1,239[1,231 to 1,246] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #283 / 419 | 1,270[1,263 to 1,277] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #283 / 391 | 1,245[1,233 to 1,256] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #285 / 421 | 1,287[1,283 to 1,292] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #285 / 393 | 1,266[1,255 to 1,277] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #286 / 419 | 1,238[1,230 to 1,246] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #287 / 414 | 1,235[1,227 to 1,243] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Claude 3.5 Sonnet (June '24) across shared benchmark boards.
7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head