Consensus score
70.0
95% interval 63.8 to 75.3
70.0
95% interval 63.8 to 75.3
73th
IQR spread 19.0 pct
98
Across 8 domains
2
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| OSWorld Epoch AI Benchmarking Hub · Default | #1 / 38Tied #1 | 72.1% | Unknown | Standard | Not stated |
| LMArena Document LMArena · Overall · Default | #10 / 46 | 1,482[1,476 to 1,488] | Unknown | Standard | 9 Nov 2026 |
| LMArena Search LMArena · Overall · search | #12 / 42 | 1,221[1,216 to 1,225] | Unknown | Standard | 9 Nov 2026 |
| LMArena Document (style control) LMArena · Overall · Default | #13 / 46 | 1,478[1,472 to 1,484] | Unknown | Standard | 9 Nov 2026 |
| SWE-Bench verified Epoch AI Benchmarking Hub · Default | #15 / 35 | 75.2%[71.4% to 79.1%] | Unknown | Standard | 21 Feb 2026 |
| LMArena Search (style control) LMArena · Overall · search | #17 / 42 | 1,201[1,196 to 1,206] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · English · Default | #17 / 167 | 1,298[1,289 to 1,306] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · English · Default | #17 / 167 | 1,282[1,274 to 1,290] | Unknown | Standard | 9 Nov 2026 |
| Vending-Bench 2 Epoch AI Benchmarking Hub · Default | #20 / 72 | $7,204.14 | Unknown | Standard | Not stated |
| LMArena Text LMArena · Coding · Default | #21 / 416 | 1,503[1,498 to 1,509] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #21 / 419 | 1,494[1,488 to 1,499] | Unknown | Standard | 11 Nov 2026 |
| FrontierMath-2025-02-28-Private Epoch AI Benchmarking Hub · Default | #23 / 101 | 32.4%[26.9% to 37.9%] | Unknown | Standard | 20 Feb 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #25 / 419 | 1,500[1,493 to 1,506] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #26 / 416 | 1,528[1,523 to 1,534] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #26 / 399 | 1,492[1,487 to 1,497] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #27 / 421 | 1,476[1,471 to 1,481] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Homework · Default | #27 / 118 | 1,311[1,301 to 1,322] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #28 / 419 | 1,506[1,501 to 1,512] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #29 / 414 | 1,481[1,475 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #29 / 421 | 1,514[1,509 to 1,519] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #30 / 421 | 1,503[1,499 to 1,507] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Diagram · Default | #30 / 123 | 1,305[1,296 to 1,313] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · OCR · Default | #30 / 123 | 1,295[1,289 to 1,301] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Creative writing vision · Default | #30 / 106 | 1,267[1,252 to 1,282] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · OCR · Default | #30 / 123 | 1,290[1,284 to 1,297] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #31 / 371 | 1,501[1,493 to 1,508] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #32 / 421 | 1,475[1,469 to 1,480] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #33 / 421 | 1,484[1,480 to 1,489] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #33 / 414 | 1,463[1,457 to 1,469] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Overall · Default | #33 / 167 | 1,283[1,277 to 1,289] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #34 / 421 | 1,491[1,486 to 1,496] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #34 / 399 | 1,479[1,474 to 1,484] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #34 / 393 | 1,484[1,475 to 1,492] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Creative writing vision · Default | #34 / 106 | 1,273[1,258 to 1,289] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Overall · Default | #34 / 167 | 1,275[1,269 to 1,281] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #35 / 421 | 1,483[1,478 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Diagram · Default | #35 / 123 | 1,305[1,296 to 1,313] | Unknown | Standard | 9 Nov 2026 |
| LMArena WebDev LMArena · Image to webdev · Default | #37 / 64 | 1,529[1,520 to 1,538] | Unknown | Standard | 15 Nov 2026 |
| LMArena Text LMArena · English · Default | #38 / 421 | 1,473[1,468 to 1,477] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #38 / 402 | 1,481[1,471 to 1,492] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #38 / 371 | 1,506[1,498 to 1,514] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #38 / 391 | 1,488[1,479 to 1,497] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Homework · Default | #38 / 118 | 1,302[1,291 to 1,313] | Unknown | Standard | 9 Nov 2026 |
| FrontierCode Epoch AI Benchmarking Hub · max · Claude Code | #40 / 51 | 24.3% | Unknown | Standard | Not stated |
| LMArena Text LMArena · Spanish · Default | #40 / 304 | 1,463[1,449 to 1,477] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #40 / 419 | 1,480[1,474 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Entity recognition · Default | #40 / 52 | 1,196[1,151 to 1,242] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #41 / 419 | 1,475[1,469 to 1,482] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #41 / 289 | 1,433[1,415 to 1,452] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #42 / 419 | 1,449[1,442 to 1,455] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #44 / 421 | 1,458[1,454 to 1,461] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Entity recognition · Default | #44 / 52 | 1,167[1,122 to 1,213] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #45 / 421 | 1,458[1,454 to 1,463] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #45 / 393 | 1,470[1,461 to 1,478] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #46 / 419 | 1,463[1,456 to 1,469] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #46 / 421 | 1,482[1,477 to 1,486] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #47 / 420 | 1,455[1,450 to 1,461] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #48 / 419 | 1,445[1,439 to 1,451] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #48 / 421 | 1,472[1,469 to 1,476] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #48 / 243 | 1,471[1,455 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Chinese · Default | #48 / 135 | 1,303[1,287 to 1,320] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Humor · Default | #49 / 102 | 1,244[1,224 to 1,263] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #50 / 419 | 1,430[1,424 to 1,436] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #50 / 395 | 1,508[1,498 to 1,518] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #50 / 402 | 1,482[1,471 to 1,492] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #50 / 288 | 1,441[1,419 to 1,463] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #50 / 421 | 1,457[1,453 to 1,461] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #50 / 304 | 1,466[1,452 to 1,480] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #52 / 420 | 1,444[1,438 to 1,449] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Chinese · Default | #53 / 135 | 1,309[1,292 to 1,326] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Humor · Default | #53 / 102 | 1,251[1,231 to 1,270] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #54 / 288 | 1,421[1,399 to 1,444] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #55 / 289 | 1,413[1,394 to 1,432] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #55 / 421 | 1,440[1,435 to 1,444] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #56 / 301 | 1,465[1,451 to 1,479] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #56 / 404 | 1,461[1,451 to 1,472] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #56 / 301 | 1,481[1,467 to 1,495] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #58 / 385 | 1,465[1,458 to 1,472] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #60 / 419 | 1,435[1,428 to 1,441] | Unknown | Standard | 11 Nov 2026 |
| LMArena WebDev LMArena · Webdev HTML · Default | #60 / 155 | 1,527[1,515 to 1,539] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Overall · Default | #61 / 156 | 1,522[1,517 to 1,527] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev · Default | #61 / 156 | 1,522[1,517 to 1,527] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev react · Default | #63 / 140 | 1,511[1,506 to 1,517] | Unknown | Standard | 15 Nov 2026 |
| Terminal Bench Epoch AI Benchmarking Hub · Simplai Agent | #65 / 202 | 53.4%[47.9% to 59%] | Unknown | Standard | 17 Feb 2026 |
| LMArena Text LMArena · Polish · Default | #66 / 243 | 1,441[1,426 to 1,457] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #66 / 404 | 1,461[1,451 to 1,471] | Unknown | Standard | 11 Nov 2026 |
| Terminal Bench Epoch AI Benchmarking Hub · Simplai Agent | #66 / 202 | 53.4%[47.9% to 58.9%] | Unknown | Standard | 14 May 2026 |
| LMArena Text (style control) LMArena · German · Default | #67 / 320 | 1,456[1,438 to 1,474] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #69 / 385 | 1,439[1,432 to 1,447] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #70 / 395 | 1,490[1,480 to 1,499] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #73 / 391 | 1,451[1,442 to 1,460] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #90 / 338 | 87.4%[83.4% to 91.3%] | Unknown | Standard | 20 Feb 2026 |
| LMArena Text LMArena · German · Default | #91 / 320 | 1,429[1,411 to 1,447] | Unknown | Standard | 11 Nov 2026 |
| ARC-AGI-2 Epoch AI Benchmarking Hub · high | #102 / 299 | 60.4% | $2.70 | Standard | Not stated |
| ARC-AGI-2 Epoch AI Benchmarking Hub · max | #111 / 299 | 58.3% | $2.72 | Standard | Not stated |
| GPQA diamond Epoch AI Benchmarking Hub · high | #123 / 338 | 83.3%[78.1% to 88.5%] | Unknown | Standard | 13 Jul 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · medium | #123 / 338 | 83.3%[78.1% to 88.5%] | Unknown | Standard | 13 Jul 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · max | #154 / 338 | 78.8%[73.1% to 84.5%] | Unknown | Standard | 6 Aug 2026 |
Same benchmark and harness measured across multiple reasoning effort settings.
Epoch AI Benchmarking Hub
60.4
$2.70
58.3
$2.72
Epoch AI Benchmarking Hub
83.3
83.3
78.8
Direct pairwise win rates for Sonnet 4.6 across shared benchmark boards.
16 shared boards
0% win
Head-to-head16 shared boards
0% win
Head-to-head15 shared boards
93% win
Head-to-head15 shared boards
80% win
Head-to-head15 shared boards
40% win
Head-to-head15 shared boards
100% win
Head-to-head15 shared boards
53% win
Head-to-head15 shared boards
53% win
Head-to-head14 shared boards
7% win
Head-to-head14 shared boards
36% win
Head-to-head