Consensus score
32.8
95% interval 27.3 to 40.4
32.8
95% interval 27.3 to 40.4
42th
IQR spread 23.1 pct
58
Across 4 domains
3
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| METR time horizon METR time horizons · duet | #17 / 23Tied #1 | 20.3 min[11.7 min to 33.4 min] | Unknown | Standard | Not stated |
| LMArena Text (style control) LMArena · Japanese · Default | #140 / 288 | 1,349[1,324 to 1,373] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #150 / 289 | 1,347[1,316 to 1,377] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #160 / 419 | 1,372[1,362 to 1,381] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #161 / 420 | 1,382[1,374 to 1,390] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #164 / 419 | 1,366[1,356 to 1,376] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #167 / 288 | 1,295[1,270 to 1,319] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #174 / 421 | 1,410[1,403 to 1,416] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #178 / 402 | 1,398[1,387 to 1,408] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #180 / 421 | 1,381[1,374 to 1,388] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #182 / 301 | 1,390[1,355 to 1,425] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #183 / 289 | 1,291[1,260 to 1,321] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #183 / 320 | 1,354[1,332 to 1,376] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #183 / 421 | 1,389[1,384 to 1,394] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #185 / 402 | 1,380[1,370 to 1,391] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #185 / 421 | 1,366[1,359 to 1,373] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #185 / 404 | 1,386[1,377 to 1,396] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #186 / 419 | 1,368[1,359 to 1,378] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #186 / 419 | 1,390[1,380 to 1,399] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #191 / 421 | 1,383[1,376 to 1,389] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #191 / 404 | 1,373[1,363 to 1,383] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #191 / 419 | 1,412[1,402 to 1,421] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #191 / 393 | 1,391[1,377 to 1,405] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #194 / 399 | 1,382[1,373 to 1,392] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #195 / 301 | 1,344[1,309 to 1,379] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #196 / 419 | 1,331[1,321 to 1,341] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #196 / 421 | 1,396[1,389 to 1,404] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #196 / 421 | 1,360[1,353 to 1,366] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #198 / 420 | 1,339[1,331 to 1,347] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #199 / 320 | 1,309[1,287 to 1,331] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #199 / 419 | 1,390[1,381 to 1,399] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #200 / 419 | 1,376[1,366 to 1,385] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #200 / 421 | 1,342[1,335 to 1,348] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #200 / 385 | 1,359[1,350 to 1,369] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #203 / 421 | 1,406[1,398 to 1,414] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #204 / 416 | 1,415[1,406 to 1,425] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #204 / 371 | 1,383[1,369 to 1,398] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #206 / 419 | 1,318[1,308 to 1,328] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #207 / 395 | 1,387[1,375 to 1,400] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #207 / 304 | 1,352[1,320 to 1,383] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #208 / 399 | 1,344[1,334 to 1,353] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #209 / 421 | 1,314[1,307 to 1,321] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #210 / 421 | 1,353[1,348 to 1,358] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #212 / 421 | 1,354[1,346 to 1,362] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #214 / 393 | 1,346[1,332 to 1,361] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #215 / 371 | 1,337[1,323 to 1,352] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #216 / 414 | 1,353[1,343 to 1,364] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #217 / 416 | 1,367[1,357 to 1,376] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #218 / 304 | 1,302[1,270 to 1,333] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #220 / 421 | 1,362[1,354 to 1,369] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #221 / 419 | 1,348[1,339 to 1,358] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #222 / 391 | 1,367[1,352 to 1,382] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #224 / 385 | 1,316[1,306 to 1,326] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #225 / 421 | 1,315[1,309 to 1,321] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #236 / 395 | 1,326[1,313 to 1,338] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #241 / 414 | 1,304[1,294 to 1,315] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #241 / 391 | 1,307[1,292 to 1,323] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #255 / 338 | 50.3%[44.8% to 55.9%] | Unknown | Standard | 27 Jan 2025 |
Direct pairwise win rates for o1-preview across shared benchmark boards.
4 shared boards
100% win
Head-to-head4 shared boards
75% win
Head-to-head4 shared boards
50% win
Head-to-head4 shared boards
50% win
Head-to-head4 shared boards
100% win
Head-to-head4 shared boards
100% win
Head-to-head4 shared boards
100% win
Head-to-head4 shared boards
100% win
Head-to-head4 shared boards
0% win
Head-to-head4 shared boards
0% win
Head-to-head