Consensus score
50.3
95% interval 41.5 to 57.1
50.3
95% interval 41.5 to 57.1
11th
IQR spread 2.7 pct
9
Across 4 domains
1
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| Legal Agent Benchmark (HLAB-Vals) Vals AI benchmarks · high | #30 / 38 | 5%[1.8% to 8.2%] | $0.19 | Standard | 15 Nov 2026 |
| Code Migration Vals AI benchmarks · high | #32 / 38 | 36.9%[29.7% to 44%] | $2.21 | Standard | 15 Nov 2026 |
| Legal Research Vals AI benchmarks · high | #33 / 38 | 28.8%[22.7% to 35%] | $0.07 | Standard | 15 Nov 2026 |
| Tax Agent Vals AI benchmarks · high | #33 / 38 | 18.2%[13.2% to 23.1%] | $0.05 | Standard | 15 Nov 2026 |
| Finance Agent Vals AI benchmarks · high | #34 / 38 | 54.7%[50.8% to 58.6%] | $0.06 | Standard | 15 Nov 2026 |
| Vals Index Vals AI benchmarks · high | #34 / 38 | 43.7%[41.3% to 46.1%] | $0.48 | Standard | 15 Nov 2026 |
| Vibe Code Bench Vals AI benchmarks · high · OpenHands | #34 / 38 | 60.9%[50.4% to 71.5%] | $0.63 | Standard | 15 Nov 2026 |
| EMB Vals AI benchmarks · high | #35 / 38 | 57.9%[52.2% to 63.6%] | $0.19 | Standard | 15 Nov 2026 |
| Terminal-Bench 4 Vals AI benchmarks · high | #35 / 38 | 3%[3% to 3%] | $0.42 | Standard | 15 Nov 2026 |
Direct pairwise win rates for Mercury 3 across shared benchmark boards.
9 shared boards
61% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
6% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
11% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
11% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
33% win
Head-to-head