Consensus score
46.3
95% interval 35.8 to 52.9
46.3
95% interval 35.8 to 52.9
7th
IQR spread 29.5 pct
3
Across 3 domains
2
Newest observation 2d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| FrontierCode Epoch AI Benchmarking Hub · none · devin-cli | #46 / 51 | 13.6% | Unknown | Standard | Not stated |
| LMArena Agent LMArena · Overall · Default | #60 / 64 | -0.2[-0.2 to -0.1] | $0.13 | Standard | 15 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #106 / 338 | 85.4%[80.4% to 90.3%] | Unknown | Standard | 10 Aug 2026 |
Direct pairwise win rates for Nemotron 3 Ultra 550B A55B across shared benchmark boards.
3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head