Consensus score
66.4
95% interval 58.2 to 71.3
66.4
95% interval 58.2 to 71.3
47th
IQR spread 35.0 pct
87
Across 6 domains
2
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| Legal Agent Benchmark (HLAB-Vals) Vals AI benchmarks · Default | #16 / 38 | 12.9%[7.4% to 18.4%] | $1.13 | Standard | 15 Nov 2026 |
| EMB Vals AI benchmarks · Default | #20 / 38 | 69.6%[64.7% to 74.4%] | $1.33 | Standard | 15 Nov 2026 |
| Terminal-Bench 4 Vals AI benchmarks · Default | #20 / 38 | 31.8%[26.7% to 37%] | $3.11 | Standard | 15 Nov 2026 |
| Legal Research Vals AI benchmarks · Default | #23 / 38 | 40.4%[33.7% to 47.1%] | $0.84 | Standard | 15 Nov 2026 |
| Code Migration Vals AI benchmarks · Default | #26 / 38 | 46.9%[39.3% to 54.6%] | $8.48 | Standard | 15 Nov 2026 |
| Tax Agent Vals AI benchmarks · Default | #26 / 38 | 27.3%[21.2% to 33.4%] | $0.55 | Standard | 15 Nov 2026 |
| Vals Index Vals AI benchmarks · Default | #26 / 38 | 54.8%[52.5% to 57%] | $2.73 | Standard | 15 Nov 2026 |
| Finance Agent Vals AI benchmarks · Default | #28 / 38 | 58.9%[54.9% to 62.9%] | $0.58 | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Image to webdev · high | #29 / 64 | 1,551[1,541 to 1,562] | Unknown | Standard | 15 Nov 2026 |
| Vibe Code Bench Vals AI benchmarks · OpenHands | #32 / 38 | 70.4%[62% to 78.8%] | $5.86 | Standard | 15 Nov 2026 |
| LMArena Vision LMArena · Diagram · Default | #37 / 123 | 1,295[1,274 to 1,315] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · English · Default | #38 / 167 | 1,279[1,260 to 1,299] | Unknown | Standard | 9 Nov 2026 |
| LMArena WebDev LMArena · Webdev react · high | #42 / 140 | 1,589[1,579 to 1,598] | Unknown | Standard | 15 Nov 2026 |
| LMArena Vision LMArena · OCR · Default | #44 / 123 | 1,278[1,265 to 1,290] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · English · Default | #44 / 167 | 1,261[1,242 to 1,281] | Unknown | Standard | 9 Nov 2026 |
| LMArena Agent LMArena · Overall · Default | #45 / 64 | -0[-0.1 to -0] | $0.70 | Standard | 15 Nov 2026 |
| LMArena Vision (style control) LMArena · Diagram · Default | #45 / 123 | 1,288[1,267 to 1,309] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Chinese · Default | #47 / 135 | 1,315[1,271 to 1,359] | Unknown | Standard | 9 Nov 2026 |
| LMArena WebDev LMArena · Overall · high | #47 / 156 | 1,572[1,564 to 1,580] | Unknown | Standard | 15 Nov 2026 |
| LMArena WebDev LMArena · Webdev · high | #47 / 156 | 1,572[1,564 to 1,580] | Unknown | Standard | 15 Nov 2026 |
| LMArena Vision (style control) LMArena · OCR · Default | #50 / 123 | 1,266[1,253 to 1,279] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #52 / 414 | 1,444[1,431 to 1,458] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Overall · Default | #52 / 167 | 1,263[1,252 to 1,274] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · German · Default | #53 / 320 | 1,454[1,416 to 1,491] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Chinese · Default | #53 / 135 | 1,296[1,252 to 1,339] | Unknown | Standard | 9 Nov 2026 |
| LMArena WebDev LMArena · Webdev HTML · high | #53 / 155 | 1,546[1,527 to 1,565] | Unknown | Standard | 15 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #54 / 421 | 1,463[1,456 to 1,470] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #54 / 404 | 1,470[1,447 to 1,494] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Creative writing vision · Default | #54 / 106 | 1,251[1,217 to 1,286] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #55 / 416 | 1,482[1,471 to 1,493] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #55 / 371 | 1,478[1,462 to 1,495] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #55 / 404 | 1,462[1,439 to 1,486] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #58 / 421 | 1,455[1,446 to 1,465] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #58 / 419 | 1,462[1,449 to 1,476] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #59 / 402 | 1,473[1,451 to 1,495] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #60 / 419 | 1,463[1,452 to 1,475] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #60 / 421 | 1,471[1,462 to 1,481] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #60 / 421 | 1,445[1,435 to 1,455] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Overall · Default | #60 / 167 | 1,245[1,234 to 1,256] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #61 / 402 | 1,465[1,443 to 1,488] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #61 / 395 | 1,499[1,480 to 1,518] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision LMArena · Homework · Default | #61 / 118 | 1,274[1,248 to 1,300] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Creative writing vision · Default | #61 / 106 | 1,231[1,196 to 1,265] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #63 / 395 | 1,495[1,476 to 1,514] | Unknown | Standard | 11 Nov 2026 |
| LMArena Vision (style control) LMArena · Homework · Default | #63 / 118 | 1,270[1,244 to 1,296] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #64 / 399 | 1,453[1,444 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #64 / 371 | 1,489[1,472 to 1,506] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #66 / 289 | 1,404[1,366 to 1,442] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #67 / 421 | 1,450[1,440 to 1,460] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #70 / 420 | 1,429[1,419 to 1,440] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #70 / 421 | 1,443[1,437 to 1,450] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #70 / 416 | 1,505[1,493 to 1,516] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #71 / 320 | 1,454[1,416 to 1,492] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #72 / 421 | 1,465[1,456 to 1,475] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #73 / 421 | 1,477[1,469 to 1,484] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #73 / 419 | 1,475[1,462 to 1,489] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #75 / 421 | 1,438[1,430 to 1,446] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #75 / 419 | 1,413[1,402 to 1,425] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #76 / 421 | 1,429[1,422 to 1,437] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #77 / 419 | 1,415[1,402 to 1,427] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #78 / 414 | 1,452[1,438 to 1,465] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #78 / 399 | 1,460[1,451 to 1,470] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #79 / 419 | 1,480[1,468 to 1,492] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #81 / 304 | 1,442[1,416 to 1,469] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #82 / 385 | 1,433[1,419 to 1,446] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #84 / 420 | 1,431[1,420 to 1,441] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #84 / 289 | 1,401[1,363 to 1,439] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #84 / 421 | 1,449[1,442 to 1,455] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #85 / 288 | 1,397[1,360 to 1,434] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #85 / 421 | 1,487[1,478 to 1,496] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #87 / 393 | 1,441[1,422 to 1,460] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #89 / 421 | 1,447[1,439 to 1,456] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #90 / 419 | 1,440[1,425 to 1,454] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #91 / 419 | 1,413[1,402 to 1,425] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #92 / 421 | 1,431[1,424 to 1,438] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #93 / 419 | 1,412[1,400 to 1,425] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #93 / 288 | 1,401[1,364 to 1,438] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #94 / 301 | 1,446[1,419 to 1,473] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #97 / 391 | 1,441[1,420 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #97 / 385 | 1,438[1,424 to 1,452] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #99 / 304 | 1,435[1,408 to 1,462] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #101 / 391 | 1,457[1,436 to 1,478] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #103 / 419 | 1,445[1,430 to 1,460] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #105 / 301 | 1,451[1,424 to 1,479] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #109 / 393 | 1,445[1,425 to 1,464] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #123 / 243 | 1,405[1,363 to 1,447] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #123 / 243 | 1,413[1,370 to 1,455] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Step 5 Preview across shared benchmark boards.
15 shared boards
27% win
Head-to-head15 shared boards
27% win
Head-to-head15 shared boards
73% win
Head-to-head15 shared boards
20% win
Head-to-head15 shared boards
27% win
Head-to-head15 shared boards
27% win
Head-to-head15 shared boards
100% win
Head-to-head15 shared boards
40% win
Head-to-head15 shared boards
13% win
Head-to-head15 shared boards
7% win
Head-to-head