Acropolis

GPT-4o (Aug '24)

OpenAIGrade B. Evidence grade B of A to D: good.ProprietaryReleased 6 Aug 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • General text (2 boards): 41 (scale 0 to 100)General text (2 boards)41
  • Math (1 boards): 5 (scale 0 to 100)Math (1 boards)5
  • Science (1 boards): 32 (scale 0 to 100)Science (1 boards)32
  • Vision (2 boards): 20 (scale 0 to 100)Vision (2 boards)20

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#96 / 101
0.3%[0% to 2.4%]UnknownStandard7 Mar 2025
LMArena Vision (style control)

LMArena · Chinese · Default

#120 / 135
1,073[1,021 to 1,125]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#122 / 135
1,009[957 to 1,061]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#134 / 167
1,120[1,104 to 1,136]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#134 / 167
1,118[1,106 to 1,131]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#138 / 167
1,064[1,052 to 1,077]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#140 / 167
1,072[1,055 to 1,088]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#182 / 288
1,292[1,273 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#193 / 289
1,289[1,264 to 1,314]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#198 / 288
1,234[1,215 to 1,254]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#210 / 420
1,341[1,334 to 1,348]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#211 / 419
1,327[1,319 to 1,336]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#211 / 320
1,313[1,295 to 1,331]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#211 / 419
1,325[1,317 to 1,333]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#215 / 289
1,218[1,194 to 1,243]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#221 / 304
1,328[1,301 to 1,355]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#230 / 301
1,328[1,299 to 1,356]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#231 / 320
1,257[1,239 to 1,275]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#234 / 304
1,269[1,242 to 1,296]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#237 / 393
1,347[1,335 to 1,360]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#239 / 385
1,325[1,316 to 1,334]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#240 / 301
1,263[1,234 to 1,291]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#240 / 421
1,317[1,311 to 1,322]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#242 / 399
1,339[1,331 to 1,347]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#243 / 421
1,319[1,313 to 1,324]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#243 / 419
1,327[1,319 to 1,335]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#245 / 404
1,309[1,301 to 1,317]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#245 / 421
1,336[1,331 to 1,340]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#246 / 419
1,274[1,266 to 1,283]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#247 / 391
1,342[1,328 to 1,356]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#248 / 420
1,290[1,283 to 1,296]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#248 / 421
1,286[1,280 to 1,293]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#249 / 419
1,348[1,340 to 1,356]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#250 / 404
1,285[1,277 to 1,293]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#251 / 419
1,267[1,259 to 1,276]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#253 / 395
1,331[1,320 to 1,342]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#253 / 421
1,348[1,343 to 1,354]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#253 / 402
1,313[1,305 to 1,322]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#256 / 338
49.2%[44.1% to 54.3%]UnknownStandard27 Jan 2025
LMArena Text

LMArena · Industry mathematical · Default

#257 / 402
1,283[1,275 to 1,292]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#258 / 371
1,312[1,299 to 1,325]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#261 / 385
1,272[1,263 to 1,281]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#263 / 416
1,360[1,352 to 1,368]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#264 / 421
1,267[1,261 to 1,272]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#264 / 421
1,327[1,321 to 1,333]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#265 / 419
1,338[1,330 to 1,345]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#267 / 399
1,283[1,275 to 1,292]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#269 / 371
1,240[1,228 to 1,253]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#269 / 419
1,279[1,271 to 1,287]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#270 / 395
1,254[1,244 to 1,265]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#270 / 421
1,262[1,256 to 1,267]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#271 / 421
1,346[1,340 to 1,353]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#272 / 421
1,283[1,278 to 1,287]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#273 / 421
1,209[1,203 to 1,215]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#275 / 414
1,302[1,293 to 1,311]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#276 / 421
1,297[1,292 to 1,303]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#277 / 416
1,283[1,276 to 1,291]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#278 / 393
1,275[1,263 to 1,288]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#279 / 419
1,277[1,269 to 1,285]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#279 / 391
1,252[1,238 to 1,266]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#280 / 421
1,264[1,258 to 1,270]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#281 / 419
1,274[1,266 to 1,282]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#283 / 421
1,278[1,271 to 1,284]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#288 / 414
1,232[1,222 to 1,241]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for GPT-4o (Aug '24) across shared benchmark boards.