Consensus score
61.0
95% interval 51.9 to 70.0
61.0
95% interval 51.9 to 70.0
65th
IQR spread 56.8 pct
70
Across 5 domains
3
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| SWE-Bench verified Epoch AI Benchmarking Hub · max | #6 / 35 | 77.6%[73.9% to 81.4%] | Unknown | Standard | 18 Jun 2026 |
| LMArena Text LMArena · Creative writing · Default | #39 / 419 | 1,446[1,439 to 1,454] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #39 / 288 | 1,445[1,421 to 1,468] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #41 / 288 | 1,455[1,431 to 1,478] | Unknown | Standard | 11 Nov 2026 |
| FrontierCode Epoch AI Benchmarking Hub · none · Mini-SWE-Agent | #42 / 51 | 17.6% | Unknown | Standard | Not stated |
| LMArena Text LMArena · Multi turn · Default | #42 / 419 | 1,467[1,460 to 1,474] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #42 / 243 | 1,459[1,441 to 1,477] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · high | #44 / 338 | 90.9%[86.9% to 94.9%] | Unknown | Standard | 6 Aug 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #45 / 419 | 1,468[1,461 to 1,475] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #46 / 301 | 1,472[1,457 to 1,486] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #48 / 320 | 1,457[1,438 to 1,476] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #49 / 421 | 1,459[1,454 to 1,464] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #49 / 419 | 1,431[1,425 to 1,438] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #49 / 393 | 1,464[1,455 to 1,474] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #49 / 391 | 1,465[1,455 to 1,475] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #49 / 420 | 1,447[1,441 to 1,453] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #49 / 419 | 1,446[1,439 to 1,454] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #49 / 320 | 1,468[1,449 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #50 / 385 | 1,454[1,445 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #50 / 304 | 1,456[1,441 to 1,471] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #50 / 301 | 1,485[1,470 to 1,499] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #51 / 421 | 1,450[1,445 to 1,455] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #51 / 421 | 1,451[1,447 to 1,455] | Unknown | Standard | 11 Nov 2026 |
| Vending-Bench 2 Epoch AI Benchmarking Hub · Default | #51 / 72 | $3,284.52 | Unknown | Standard | Not stated |
| LMArena Text (style control) LMArena · Multi turn · Default | #52 / 419 | 1,475[1,468 to 1,482] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #54 / 414 | 1,443[1,436 to 1,450] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #55 / 419 | 1,466[1,460 to 1,472] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #55 / 393 | 1,474[1,465 to 1,484] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #55 / 243 | 1,464[1,446 to 1,482] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #56 / 421 | 1,439[1,434 to 1,444] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #57 / 399 | 1,458[1,452 to 1,463] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #58 / 421 | 1,446[1,440 to 1,451] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #58 / 420 | 1,451[1,445 to 1,457] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #59 / 421 | 1,461[1,457 to 1,466] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #61 / 419 | 1,436[1,429 to 1,442] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · max | #62 / 338 | 89.6%[86.2% to 93.1%] | Unknown | Standard | 16 Jun 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #62 / 414 | 1,460[1,453 to 1,466] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #62 / 399 | 1,472[1,466 to 1,477] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #63 / 289 | 1,407[1,388 to 1,426] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #63 / 421 | 1,453[1,448 to 1,459] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #63 / 385 | 1,461[1,453 to 1,469] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #64 / 419 | 1,479[1,472 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #65 / 391 | 1,477[1,467 to 1,487] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #66 / 421 | 1,469[1,463 to 1,474] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #66 / 421 | 1,458[1,454 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #66 / 304 | 1,457[1,441 to 1,472] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #67 / 421 | 1,462[1,457 to 1,467] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #68 / 421 | 1,467[1,462 to 1,472] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #68 / 421 | 1,480[1,476 to 1,485] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #69 / 419 | 1,485[1,479 to 1,491] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #69 / 289 | 1,415[1,396 to 1,434] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #70 / 421 | 1,445[1,440 to 1,449] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #72 / 416 | 1,469[1,463 to 1,475] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #72 / 371 | 1,463[1,455 to 1,471] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #72 / 402 | 1,455[1,444 to 1,466] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #73 / 421 | 1,491[1,486 to 1,497] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #76 / 395 | 1,481[1,470 to 1,492] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #76 / 402 | 1,459[1,448 to 1,470] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #80 / 404 | 1,442[1,431 to 1,453] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #80 / 371 | 1,480[1,471 to 1,488] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #81 / 416 | 1,501[1,495 to 1,506] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #82 / 395 | 1,488[1,477 to 1,499] | Unknown | Standard | 11 Nov 2026 |
| LMArena WebDev LMArena · Overall · Default | #84 / 156 | 1,449[1,442 to 1,455] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev · Default | #84 / 156 | 1,449[1,442 to 1,455] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev react · Default | #85 / 140 | 1,441[1,434 to 1,449] | Unknown | Standard | 15 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #89 / 404 | 1,443[1,432 to 1,454] | Unknown | Standard | 11 Nov 2026 |
| LMArena WebDev LMArena · Webdev HTML · Default | #91 / 155 | 1,434[1,418 to 1,450] | Unknown | Standard | 15 Nov 2026 |
| Bug Hunt Bench Bug Hunt Bench · max · Claude Code | #104 / 145 | 16 | $1.89 | Standard | 10 Sept 2026 |
| Bug Hunt Bench Bug Hunt Bench · high · Claude Code | #118 / 145 | 13 | $1.08 | Standard | 10 Sept 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · none | #188 / 338 | 73.2%[67% to 79.4%] | Unknown | Standard | 6 Aug 2026 |
Same benchmark and harness measured across multiple reasoning effort settings.
Bug Hunt Bench · Claude Code
13.0
$1.08
16.0
$1.89
Epoch AI Benchmarking Hub
73.2
90.9
89.6
Direct pairwise win rates for DeepSeek V4-Pro across shared benchmark boards.
7 shared boards
0% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
7% win
Head-to-head7 shared boards
29% win
Head-to-head7 shared boards
0% win
Head-to-head7 shared boards
14% win
Head-to-head7 shared boards
14% win
Head-to-head7 shared boards
29% win
Head-to-head7 shared boards
14% win
Head-to-head7 shared boards
0% win
Head-to-head