Consensus score
77.8
95% interval 64.5 to 86.6
77.8
95% interval 64.5 to 86.6
59th
IQR spread 13.5 pct
9
Across 4 domains
1
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| Tax Agent Vals AI benchmarks · Default | #3 / 38Tied #1 | 49.7%[42.6% to 56.7%] | $4.07 | Standard | 15 Nov 2026 |
| Legal Agent Benchmark (HLAB-Vals) Vals AI benchmarks · Default | #11 / 38 | 15.4%[9.4% to 21.4%] | $3.36 | Standard | 15 Nov 2026 |
| EMB Vals AI benchmarks · Default | #13 / 38Tied #1 | 72%[67.3% to 76.7%] | $4.43 | Standard | 15 Nov 2026 |
| Legal Research Vals AI benchmarks · Default | #13 / 38 | 46.2%[39.4% to 52.9%] | $5.31 | Standard | 15 Nov 2026 |
| Code Migration Vals AI benchmarks · Default | #16 / 38 | 54.5%[47.4% to 61.7%] | $25.86 | Standard | 15 Nov 2026 |
| Terminal-Bench 4 Vals AI benchmarks · Default | #16 / 38 | 38.9%[36.3% to 41.5%] | $12.15 | Standard | 15 Nov 2026 |
| Vals Index Vals AI benchmarks · Default | #18 / 38 | 59%[56.9% to 61.2%] | $8.73 | Standard | 15 Nov 2026 |
| Finance Agent Vals AI benchmarks · Default | #29 / 38 | 58.8%[54.7% to 63%] | $2.99 | Standard | 15 Nov 2026 |
| Vibe Code Bench Vals AI benchmarks · OpenHands | #29 / 38 | 77.1%[69.8% to 84.4%] | $11.67 | Standard | 15 Nov 2026 |
Direct pairwise win rates for Qwen3.8 Max Internal across shared benchmark boards.
9 shared boards
100% win
Head-to-head9 shared boards
89% win
Head-to-head9 shared boards
56% win
Head-to-head9 shared boards
28% win
Head-to-head9 shared boards
50% win
Head-to-head9 shared boards
89% win
Head-to-head9 shared boards
33% win
Head-to-head9 shared boards
89% win
Head-to-head9 shared boards
44% win
Head-to-head9 shared boards
44% win
Head-to-head