Consensus score
45.0
95% interval 40.1 to 49.0
45.0
95% interval 40.1 to 49.0
51th
IQR spread 13.5 pct
92
Across 5 domains
2
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| GDPval Epoch AI Benchmarking Hub · high | #8 / 11 | 25.3% | Unknown | Standard | Not stated |
| LMArena Vision (style control) LMArena · Captioning · Default | #18 / 34 | 1,184[1,153 to 1,216] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Entity recognition · Default | #20 / 52 | 1,221[1,188 to 1,255] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Captioning · Default | #22 / 34 | 1,203[1,174 to 1,233] | Unknown | Standard | 9 Nov 2026 |
| HLE Epoch AI Benchmarking Hub · high | #26 / 56 | 18.1%[15.1% to 21%] | Unknown | Standard | Not stated |
| LMArena Vision (style control) LMArena · Creative writing · Default | #27 / 34 | 1,164[1,147 to 1,180] | Unknown | Standard | 9 Jan 2026 |
| HLE Epoch AI Benchmarking Hub · medium | #28 / 56 | 14.3%[11.6% to 17%] | Unknown | Standard | Not stated |
| LMArena Vision LMArena · Creative writing · Default | #30 / 34 | 1,161[1,145 to 1,177] | Unknown | Standard | 9 Jan 2026 |
| FrontierMath-2025-02-28-Private Epoch AI Benchmarking Hub · high | #34 / 101 | 24.8%[19.8% to 29.8%] | Unknown | Standard | 13 Nov 2025 |
| LMArena Vision LMArena · Entity recognition · Default | #34 / 52 | 1,220[1,188 to 1,253] | Unknown | Standard | 9 Nov 2026 |
| FrontierMath-2025-02-28-Private Epoch AI Benchmarking Hub · medium | #44 / 101 | 19%[14.4% to 23.5%] | Unknown | Standard | 13 Nov 2025 |
| FrontierMath-2025-02-28-Private Epoch AI Benchmarking Hub · low | #53 / 101 | 10.7%[7.1% to 14.3%] | Unknown | Standard | 16 Nov 2025 |
| LMArena Vision (style control) LMArena · Homework · Default | #74 / 118 | 1,254[1,238 to 1,270] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Humor · Default | #81 / 102 | 1,193[1,172 to 1,214] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Humor · Default | #82 / 102 | 1,199[1,179 to 1,219] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Homework · Default | #86 / 118 | 1,235[1,219 to 1,251] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Chinese · Default | #86 / 135 | 1,229[1,211 to 1,246] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Overall · Default | #91 / 167 | 1,201[1,194 to 1,208] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Chinese · Default | #93 / 135 | 1,218[1,201 to 1,235] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Diagram · Default | #93 / 123 | 1,219[1,206 to 1,232] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · English · Default | #94 / 167 | 1,200[1,191 to 1,209] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · OCR · Default | #94 / 123 | 1,211[1,202 to 1,220] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · OCR · Default | #96 / 123 | 1,197[1,188 to 1,206] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Diagram · Default | #97 / 123 | 1,197[1,184 to 1,210] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Creative writing vision · Default | #97 / 106 | 1,167[1,146 to 1,187] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · English · Default | #98 / 167 | 1,200[1,190 to 1,209] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Overall · Default | #98 / 167 | 1,194[1,187 to 1,201] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Creative writing vision · Default | #99 / 106 | 1,167[1,147 to 1,187] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #128 / 243 | 1,405[1,393 to 1,417] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #134 / 404 | 1,418[1,407 to 1,428] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #136 / 289 | 1,356[1,336 to 1,375] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #142 / 288 | 1,347[1,328 to 1,366] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · high | #150 / 338 | 79.6%[74.9% to 84.3%] | Unknown | Standard | 16 Apr 2025 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #154 / 402 | 1,413[1,402 to 1,424] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · medium | #159 / 338 | 77.8%[72% to 83.6%] | Unknown | Standard | 7 Aug 2026 |
| LMArena Text (style control) LMArena · French · Default | #160 / 301 | 1,412[1,387 to 1,437] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #161 / 288 | 1,309[1,289 to 1,328] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #163 / 320 | 1,378[1,360 to 1,395] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #167 / 391 | 1,418[1,406 to 1,431] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #168 / 289 | 1,312[1,293 to 1,332] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #168 / 243 | 1,358[1,346 to 1,369] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #170 / 304 | 1,385[1,366 to 1,404] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #174 / 371 | 1,407[1,395 to 1,419] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #175 / 393 | 1,399[1,387 to 1,410] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #177 / 421 | 1,375[1,370 to 1,380] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #178 / 404 | 1,389[1,378 to 1,400] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · low | #179 / 338 | 75.3%[69.2% to 81.3%] | Unknown | Standard | 11 Jul 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #180 / 421 | 1,391[1,387 to 1,395] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #181 / 421 | 1,368[1,363 to 1,374] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #182 / 421 | 1,404[1,399 to 1,409] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #183 / 301 | 1,363[1,339 to 1,388] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #184 / 416 | 1,433[1,426 to 1,440] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #184 / 419 | 1,419[1,412 to 1,426] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #184 / 419 | 1,349[1,342 to 1,356] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #184 / 419 | 1,404[1,397 to 1,411] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #186 / 395 | 1,404[1,393 to 1,415] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #186 / 421 | 1,422[1,416 to 1,427] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #187 / 421 | 1,406[1,401 to 1,411] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #188 / 320 | 1,336[1,318 to 1,353] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #188 / 385 | 1,374[1,364 to 1,384] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #189 / 402 | 1,379[1,368 to 1,389] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #191 / 414 | 1,379[1,371 to 1,386] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #192 / 419 | 1,383[1,375 to 1,390] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #194 / 421 | 1,368[1,362 to 1,374] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #196 / 420 | 1,354[1,348 to 1,361] | Unknown | Standard | 11 Nov 2026 |
| ARC-AGI-2 Epoch AI Benchmarking Hub · high | #197 / 299 | 6.1% | $0.86 | Standard | Not stated |
| LMArena Text (style control) LMArena · Creative writing · Default | #199 / 419 | 1,337[1,329 to 1,345] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #200 / 304 | 1,346[1,327 to 1,366] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #203 / 391 | 1,361[1,349 to 1,374] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #205 / 421 | 1,336[1,331 to 1,341] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #208 / 421 | 1,315[1,309 to 1,320] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #208 / 371 | 1,342[1,330 to 1,355] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #208 / 419 | 1,350[1,342 to 1,357] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #209 / 393 | 1,350[1,339 to 1,362] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #209 / 421 | 1,353[1,349 to 1,357] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #209 / 399 | 1,369[1,362 to 1,376] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #210 / 385 | 1,334[1,324 to 1,343] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #211 / 416 | 1,368[1,361 to 1,375] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #211 / 421 | 1,367[1,362 to 1,372] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #212 / 419 | 1,308[1,301 to 1,315] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #212 / 421 | 1,367[1,361 to 1,372] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #214 / 421 | 1,350[1,345 to 1,355] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #215 / 419 | 1,366[1,359 to 1,372] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #215 / 419 | 1,354[1,346 to 1,361] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #217 / 421 | 1,320[1,314 to 1,326] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #218 / 395 | 1,354[1,343 to 1,365] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #220 / 420 | 1,315[1,309 to 1,322] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #222 / 414 | 1,325[1,317 to 1,332] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #228 / 419 | 1,294[1,286 to 1,302] | Unknown | Standard | 11 Nov 2026 |
| ARC-AGI-2 Epoch AI Benchmarking Hub · medium | #231 / 299 | 2.4% | $0.23 | Standard | Not stated |
| LMArena Text LMArena · Longer query · Default | #239 / 399 | 1,314[1,307 to 1,321] | Unknown | Standard | 11 Nov 2026 |
| ARC-AGI-2 Epoch AI Benchmarking Hub · low | #247 / 299 | 1.7% | $0.05 | Standard | Not stated |
Same benchmark and harness measured across multiple reasoning effort settings.
Epoch AI Benchmarking Hub
1.7
$0.05
2.4
$0.23
6.1
$0.86
Epoch AI Benchmarking Hub
10.7
19.0
24.8
Epoch AI Benchmarking Hub
75.3
77.8
79.6
Epoch AI Benchmarking Hub
14.3
18.1
Direct pairwise win rates for o4-mini across shared benchmark boards.
9 shared boards
0% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
0% win
Head-to-head9 shared boards
11% win
Head-to-head8 shared boards
88% win
Head-to-head8 shared boards
75% win
Head-to-head8 shared boards
50% win
Head-to-head8 shared boards
50% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head