Acropolis

o4-mini

OpenAIGrade B. Evidence grade B of A to D: good.ProprietaryReleased 16 Apr 2025Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Finance (1 boards): 30 (scale 0 to 100)Finance (1 boards)30
  • General text (5 boards): 51 (scale 0 to 100)General text (5 boards)51
  • Math (2 boards): 58 (scale 0 to 100)Math (2 boards)58
  • Science (3 boards): 51 (scale 0 to 100)Science (3 boards)51
  • Vision (2 boards): 46 (scale 0 to 100)Vision (2 boards)46

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
GDPval

Epoch AI Benchmarking Hub · high

#8 / 11
25.3%UnknownStandardNot stated
LMArena Vision (style control)

LMArena · Captioning · Default

#18 / 34
1,184[1,153 to 1,216]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Entity recognition · Default

#20 / 52
1,221[1,188 to 1,255]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Captioning · Default

#22 / 34
1,203[1,174 to 1,233]UnknownStandard9 Nov 2026
HLE

Epoch AI Benchmarking Hub · high

#26 / 56
18.1%[15.1% to 21%]UnknownStandardNot stated
LMArena Vision (style control)

LMArena · Creative writing · Default

#27 / 34
1,164[1,147 to 1,180]UnknownStandard9 Jan 2026
HLE

Epoch AI Benchmarking Hub · medium

#28 / 56
14.3%[11.6% to 17%]UnknownStandardNot stated
LMArena Vision

LMArena · Creative writing · Default

#30 / 34
1,161[1,145 to 1,177]UnknownStandard9 Jan 2026
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · high

#34 / 101
24.8%[19.8% to 29.8%]UnknownStandard13 Nov 2025
LMArena Vision

LMArena · Entity recognition · Default

#34 / 52
1,220[1,188 to 1,253]UnknownStandard9 Nov 2026
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · medium

#44 / 101
19%[14.4% to 23.5%]UnknownStandard13 Nov 2025
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · low

#53 / 101
10.7%[7.1% to 14.3%]UnknownStandard16 Nov 2025
LMArena Vision (style control)

LMArena · Homework · Default

#74 / 118
1,254[1,238 to 1,270]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Humor · Default

#81 / 102
1,193[1,172 to 1,214]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Humor · Default

#82 / 102
1,199[1,179 to 1,219]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Homework · Default

#86 / 118
1,235[1,219 to 1,251]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Chinese · Default

#86 / 135
1,229[1,211 to 1,246]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#91 / 167
1,201[1,194 to 1,208]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#93 / 135
1,218[1,201 to 1,235]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Diagram · Default

#93 / 123
1,219[1,206 to 1,232]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#94 / 167
1,200[1,191 to 1,209]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · OCR · Default

#94 / 123
1,211[1,202 to 1,220]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · OCR · Default

#96 / 123
1,197[1,188 to 1,206]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Diagram · Default

#97 / 123
1,197[1,184 to 1,210]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Creative writing vision · Default

#97 / 106
1,167[1,146 to 1,187]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#98 / 167
1,200[1,190 to 1,209]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#98 / 167
1,194[1,187 to 1,201]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Creative writing vision · Default

#99 / 106
1,167[1,147 to 1,187]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#128 / 243
1,405[1,393 to 1,417]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#134 / 404
1,418[1,407 to 1,428]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#136 / 289
1,356[1,336 to 1,375]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#142 / 288
1,347[1,328 to 1,366]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · high

#150 / 338
79.6%[74.9% to 84.3%]UnknownStandard16 Apr 2025
LMArena Text (style control)

LMArena · Industry mathematical · Default

#154 / 402
1,413[1,402 to 1,424]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · medium

#159 / 338
77.8%[72% to 83.6%]UnknownStandard7 Aug 2026
LMArena Text (style control)

LMArena · French · Default

#160 / 301
1,412[1,387 to 1,437]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#161 / 288
1,309[1,289 to 1,328]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#163 / 320
1,378[1,360 to 1,395]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#167 / 391
1,418[1,406 to 1,431]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#168 / 289
1,312[1,293 to 1,332]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Polish · Default

#168 / 243
1,358[1,346 to 1,369]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#170 / 304
1,385[1,366 to 1,404]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#174 / 371
1,407[1,395 to 1,419]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#175 / 393
1,399[1,387 to 1,410]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#177 / 421
1,375[1,370 to 1,380]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#178 / 404
1,389[1,378 to 1,400]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · low

#179 / 338
75.3%[69.2% to 81.3%]UnknownStandard11 Jul 2026
LMArena Text (style control)

LMArena · Overall · Default

#180 / 421
1,391[1,387 to 1,395]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#181 / 421
1,368[1,363 to 1,374]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#182 / 421
1,404[1,399 to 1,409]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#183 / 301
1,363[1,339 to 1,388]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#184 / 416
1,433[1,426 to 1,440]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#184 / 419
1,419[1,412 to 1,426]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#184 / 419
1,349[1,342 to 1,356]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#184 / 419
1,404[1,397 to 1,411]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#186 / 395
1,404[1,393 to 1,415]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#186 / 421
1,422[1,416 to 1,427]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#187 / 421
1,406[1,401 to 1,411]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#188 / 320
1,336[1,318 to 1,353]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#188 / 385
1,374[1,364 to 1,384]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#189 / 402
1,379[1,368 to 1,389]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#191 / 414
1,379[1,371 to 1,386]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#192 / 419
1,383[1,375 to 1,390]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#194 / 421
1,368[1,362 to 1,374]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#196 / 420
1,354[1,348 to 1,361]UnknownStandard11 Nov 2026
ARC-AGI-2

Epoch AI Benchmarking Hub · high

#197 / 299
6.1%$0.86StandardNot stated
LMArena Text (style control)

LMArena · Creative writing · Default

#199 / 419
1,337[1,329 to 1,345]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#200 / 304
1,346[1,327 to 1,366]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#203 / 391
1,361[1,349 to 1,374]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#205 / 421
1,336[1,331 to 1,341]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#208 / 421
1,315[1,309 to 1,320]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#208 / 371
1,342[1,330 to 1,355]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#208 / 419
1,350[1,342 to 1,357]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#209 / 393
1,350[1,339 to 1,362]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#209 / 421
1,353[1,349 to 1,357]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#209 / 399
1,369[1,362 to 1,376]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#210 / 385
1,334[1,324 to 1,343]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#211 / 416
1,368[1,361 to 1,375]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#211 / 421
1,367[1,362 to 1,372]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#212 / 419
1,308[1,301 to 1,315]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#212 / 421
1,367[1,361 to 1,372]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#214 / 421
1,350[1,345 to 1,355]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#215 / 419
1,366[1,359 to 1,372]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#215 / 419
1,354[1,346 to 1,361]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#217 / 421
1,320[1,314 to 1,326]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#218 / 395
1,354[1,343 to 1,365]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#220 / 420
1,315[1,309 to 1,322]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#222 / 414
1,325[1,317 to 1,332]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#228 / 419
1,294[1,286 to 1,302]UnknownStandard11 Nov 2026
ARC-AGI-2

Epoch AI Benchmarking Hub · medium

#231 / 299
2.4%$0.23StandardNot stated
LMArena Text

LMArena · Longer query · Default

#239 / 399
1,314[1,307 to 1,321]UnknownStandard11 Nov 2026
ARC-AGI-2

Epoch AI Benchmarking Hub · low

#247 / 299
1.7%$0.05StandardNot stated

Reasoning effort scaling

Same benchmark and harness measured across multiple reasoning effort settings.

  • ARC-AGI-2

    Epoch AI Benchmarking Hub

    Monotone. Evidence grade A of A to D: strongest.
    low

    1.7

    $0.05

    medium

    2.4

    $0.23

    high

    6.1

    $0.86

  • FrontierMath-2025-02-28-Private

    Epoch AI Benchmarking Hub

    Monotone. Evidence grade A of A to D: strongest.
    low

    10.7

    medium

    19.0

    high

    24.8

  • GPQA diamond

    Epoch AI Benchmarking Hub

    Monotone. Evidence grade A of A to D: strongest.
    low

    75.3

    medium

    77.8

    high

    79.6

  • HLE

    Epoch AI Benchmarking Hub

    Monotone. Evidence grade A of A to D: strongest.
    medium

    14.3

    high

    18.1

Closest head-to-head rivals

Direct pairwise win rates for o4-mini across shared benchmark boards.