Consensus score
56.4
95% interval 47.8 to 61.6
56.4
95% interval 47.8 to 61.6
69th
IQR spread 9.3 pct
84
Across 4 domains
2
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| LMArena Vision LMArena · Entity recognition · Default | #14 / 52 | 1,271[1,234 to 1,307] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Captioning · Default | #15 / 34 | 1,227[1,170 to 1,284] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Captioning · Default | #23 / 34 | 1,171[1,114 to 1,229] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Entity recognition · Default | #24 / 52 | 1,218[1,181 to 1,255] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Homework · Default | #43 / 118 | 1,292[1,283 to 1,302] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Creative writing vision · Default | #46 / 106 | 1,262[1,249 to 1,275] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Humor · Default | #47 / 102 | 1,264[1,247 to 1,281] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Chinese · Default | #48 / 135 | 1,315[1,300 to 1,330] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Humor · Default | #48 / 102 | 1,244[1,227 to 1,261] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · English · Default | #49 / 167 | 1,269[1,262 to 1,276] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Creative writing vision · Default | #49 / 106 | 1,246[1,233 to 1,258] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Homework · Default | #49 / 118 | 1,287[1,278 to 1,297] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #50 / 288 | 1,426[1,407 to 1,445] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Diagram · Default | #51 / 123 | 1,277[1,270 to 1,284] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · OCR · Default | #53 / 123 | 1,270[1,265 to 1,275] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Overall · Default | #54 / 167 | 1,262[1,257 to 1,268] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #55 / 243 | 1,448[1,434 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Chinese · Default | #55 / 135 | 1,291[1,276 to 1,306] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · English · Default | #55 / 167 | 1,251[1,243 to 1,258] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · French · Default | #57 / 301 | 1,464[1,451 to 1,476] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Diagram · Default | #57 / 123 | 1,273[1,266 to 1,281] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #58 / 395 | 1,498[1,490 to 1,505] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · OCR · Default | #58 / 123 | 1,260[1,255 to 1,265] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Overall · Default | #59 / 167 | 1,246[1,240 to 1,251] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #64 / 391 | 1,455[1,448 to 1,463] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #66 / 288 | 1,428[1,409 to 1,447] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #67 / 320 | 1,443[1,427 to 1,459] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #67 / 395 | 1,496[1,488 to 1,504] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #68 / 414 | 1,435[1,430 to 1,441] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #69 / 419 | 1,457[1,452 to 1,463] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #71 / 404 | 1,453[1,445 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #74 / 402 | 1,452[1,444 to 1,461] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #74 / 421 | 1,430[1,426 to 1,434] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #75 / 371 | 1,462[1,456 to 1,469] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #75 / 304 | 1,444[1,432 to 1,456] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #77 / 301 | 1,471[1,459 to 1,483] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #78 / 421 | 1,462[1,458 to 1,466] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #78 / 399 | 1,442[1,438 to 1,446] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #80 / 419 | 1,445[1,439 to 1,450] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #80 / 404 | 1,450[1,441 to 1,458] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #81 / 421 | 1,433[1,429 to 1,437] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #82 / 421 | 1,448[1,444 to 1,451] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #83 / 416 | 1,463[1,459 to 1,468] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #83 / 421 | 1,438[1,434 to 1,441] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #83 / 371 | 1,478[1,471 to 1,484] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #84 / 421 | 1,424[1,420 to 1,428] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #84 / 289 | 1,391[1,375 to 1,407] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #84 / 385 | 1,431[1,425 to 1,438] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #85 / 393 | 1,442[1,435 to 1,450] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #85 / 391 | 1,467[1,459 to 1,474] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #86 / 420 | 1,415[1,411 to 1,420] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #86 / 414 | 1,447[1,441 to 1,452] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #87 / 419 | 1,465[1,460 to 1,471] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #87 / 399 | 1,453[1,449 to 1,458] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #87 / 243 | 1,446[1,432 to 1,461] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #88 / 419 | 1,449[1,445 to 1,454] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #88 / 402 | 1,453[1,444 to 1,461] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #89 / 419 | 1,452[1,446 to 1,457] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #89 / 304 | 1,443[1,431 to 1,454] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #90 / 421 | 1,432[1,428 to 1,436] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #91 / 421 | 1,443[1,439 to 1,447] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #91 / 320 | 1,442[1,426 to 1,458] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #93 / 421 | 1,463[1,460 to 1,467] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #93 / 421 | 1,434[1,430 to 1,439] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · none | #95 / 338 | 86.4%[81.6% to 91.2%] | Unknown | Standard | 7 Aug 2026 |
| LMArena Text LMArena · Creative writing · Default | #96 / 419 | 1,402[1,397 to 1,408] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #96 / 289 | 1,391[1,375 to 1,407] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #97 / 416 | 1,490[1,486 to 1,495] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #97 / 420 | 1,421[1,416 to 1,426] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #97 / 421 | 1,441[1,438 to 1,444] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #99 / 421 | 1,440[1,436 to 1,444] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #99 / 419 | 1,466[1,462 to 1,471] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #99 / 421 | 1,480[1,476 to 1,484] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #101 / 338 | 85.9%[81% to 90.7%] | Unknown | Standard | 7 Aug 2026 |
| LMArena Text (style control) LMArena · English · Default | #101 / 421 | 1,449[1,445 to 1,453] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #101 / 385 | 1,437[1,431 to 1,443] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #102 / 393 | 1,447[1,440 to 1,455] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #103 / 419 | 1,398[1,393 to 1,403] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #103 / 419 | 1,406[1,401 to 1,412] | Unknown | Standard | 11 Nov 2026 |
| LMArena WebDev LMArena · Webdev react · Default | #103 / 140 | 1,387[1,381 to 1,393] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Overall · Default | #104 / 156 | 1,400[1,395 to 1,405] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev · Default | #104 / 156 | 1,400[1,395 to 1,405] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev HTML · Default | #105 / 155 | 1,409[1,397 to 1,421] | Unknown | Standard | 15 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #108 / 419 | 1,403[1,398 to 1,408] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Qwen3.5 397B A17B across shared benchmark boards.
6 shared boards
0% win
Head-to-head6 shared boards
0% win
Head-to-head6 shared boards
0% win
Head-to-head6 shared boards
83% win
Head-to-head6 shared boards
33% win
Head-to-head6 shared boards
67% win
Head-to-head6 shared boards
0% win
Head-to-head6 shared boards
50% win
Head-to-head6 shared boards
0% win
Head-to-head6 shared boards
33% win
Head-to-head