Acropolis

GPT-4o (May '24)

OpenAIGrade A. Evidence grade A of A to D: strongest.ProprietaryReleased 13 May 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Agentic (1 boards): 18 (scale 0 to 100)Agentic (1 boards)18
  • Coding (1 boards): 18 (scale 0 to 100)Coding (1 boards)18
  • General text (2 boards): 46 (scale 0 to 100)General text (2 boards)46
  • Science (1 boards): 30 (scale 0 to 100)Science (1 boards)30
  • Vision (2 boards): 33 (scale 0 to 100)Vision (2 boards)33

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
METR time horizon

METR time horizons · metr_agents/react

#19 / 23Tied #1
7 min[4 min to 12.9 min]UnknownStandardNot stated
LMArena Vision (style control)

LMArena · Chinese · Default

#107 / 135
1,158[1,119 to 1,196]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#109 / 243
1,425[1,368 to 1,482]UnknownStandard11 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#110 / 135
1,132[1,094 to 1,170]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#110 / 167
1,162[1,153 to 1,171]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#113 / 167
1,166[1,155 to 1,178]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#124 / 167
1,147[1,136 to 1,158]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#124 / 167
1,137[1,128 to 1,145]UnknownStandard9 Nov 2026
LMArena Text

LMArena · Polish · Default

#163 / 243
1,365[1,308 to 1,421]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#176 / 288
1,305[1,290 to 1,321]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#187 / 288
1,257[1,241 to 1,273]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#187 / 289
1,294[1,277 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#197 / 419
1,338[1,331 to 1,345]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#198 / 419
1,338[1,330 to 1,345]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#198 / 320
1,329[1,316 to 1,343]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#202 / 301
1,360[1,339 to 1,381]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#204 / 420
1,345[1,340 to 1,351]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#208 / 289
1,234[1,216 to 1,252]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#212 / 320
1,282[1,269 to 1,296]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#212 / 393
1,371[1,361 to 1,381]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#213 / 304
1,341[1,321 to 1,362]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#214 / 301
1,304[1,283 to 1,325]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#221 / 304
1,292[1,272 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#223 / 421
1,330[1,325 to 1,334]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#227 / 385
1,333[1,326 to 1,340]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#229 / 421
1,305[1,299 to 1,310]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#229 / 419
1,340[1,334 to 1,347]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#229 / 421
1,346[1,343 to 1,350]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#232 / 419
1,291[1,284 to 1,298]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#233 / 419
1,289[1,283 to 1,296]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#235 / 391
1,353[1,342 to 1,364]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#236 / 421
1,325[1,320 to 1,331]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#237 / 420
1,298[1,292 to 1,304]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#240 / 419
1,354[1,347 to 1,361]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#242 / 393
1,314[1,304 to 1,324]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#242 / 421
1,356[1,352 to 1,361]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#247 / 421
1,360[1,354 to 1,365]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#247 / 404
1,305[1,298 to 1,311]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#248 / 419
1,302[1,295 to 1,308]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#248 / 385
1,285[1,278 to 1,293]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#249 / 421
1,283[1,278 to 1,288]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#249 / 395
1,339[1,331 to 1,348]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#249 / 414
1,321[1,314 to 1,329]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#250 / 416
1,369[1,362 to 1,375]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#251 / 404
1,284[1,277 to 1,291]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#251 / 421
1,338[1,332 to 1,343]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#252 / 421
1,300[1,297 to 1,304]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#253 / 421
1,278[1,273 to 1,283]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#254 / 421
1,238[1,233 to 1,244]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#254 / 399
1,332[1,325 to 1,339]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#255 / 402
1,284[1,277 to 1,292]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#257 / 419
1,348[1,341 to 1,354]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#257 / 402
1,310[1,303 to 1,317]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#258 / 395
1,277[1,269 to 1,286]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#258 / 421
1,312[1,308 to 1,317]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#259 / 371
1,250[1,240 to 1,260]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#259 / 371
1,311[1,301 to 1,322]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#261 / 338
48.9%[43.7% to 54%]UnknownStandard27 Jan 2025
LMArena Text

LMArena · Industry medicine and healthcare · Default

#261 / 391
1,278[1,267 to 1,289]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#262 / 419
1,293[1,286 to 1,299]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#263 / 421
1,281[1,275 to 1,286]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#263 / 399
1,288[1,281 to 1,295]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#264 / 416
1,297[1,291 to 1,303]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#264 / 419
1,295[1,288 to 1,302]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#266 / 414
1,261[1,254 to 1,269]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#267 / 421
1,297[1,292 to 1,303]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for GPT-4o (May '24) across shared benchmark boards.