Acropolis

o1-preview

OpenAIGrade A. Evidence grade A of A to D: strongest.ProprietaryReleased 12 Sept 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Agentic (1 boards): 27 (scale 0 to 100)Agentic (1 boards)27
  • Coding (1 boards): 27 (scale 0 to 100)Coding (1 boards)27
  • General text (2 boards): 56 (scale 0 to 100)General text (2 boards)56
  • Science (1 boards): 32 (scale 0 to 100)Science (1 boards)32

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
METR time horizon

METR time horizons · duet

#17 / 23Tied #1
20.3 min[11.7 min to 33.4 min]UnknownStandardNot stated
LMArena Text (style control)

LMArena · Japanese · Default

#140 / 288
1,349[1,324 to 1,373]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#150 / 289
1,347[1,316 to 1,377]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#160 / 419
1,372[1,362 to 1,381]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#161 / 420
1,382[1,374 to 1,390]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#164 / 419
1,366[1,356 to 1,376]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#167 / 288
1,295[1,270 to 1,319]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#174 / 421
1,410[1,403 to 1,416]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#178 / 402
1,398[1,387 to 1,408]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#180 / 421
1,381[1,374 to 1,388]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#182 / 301
1,390[1,355 to 1,425]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#183 / 289
1,291[1,260 to 1,321]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#183 / 320
1,354[1,332 to 1,376]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#183 / 421
1,389[1,384 to 1,394]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#185 / 402
1,380[1,370 to 1,391]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#185 / 421
1,366[1,359 to 1,373]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#185 / 404
1,386[1,377 to 1,396]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#186 / 419
1,368[1,359 to 1,378]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#186 / 419
1,390[1,380 to 1,399]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#191 / 421
1,383[1,376 to 1,389]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#191 / 404
1,373[1,363 to 1,383]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#191 / 419
1,412[1,402 to 1,421]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#191 / 393
1,391[1,377 to 1,405]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#194 / 399
1,382[1,373 to 1,392]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#195 / 301
1,344[1,309 to 1,379]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#196 / 419
1,331[1,321 to 1,341]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#196 / 421
1,396[1,389 to 1,404]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#196 / 421
1,360[1,353 to 1,366]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#198 / 420
1,339[1,331 to 1,347]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#199 / 320
1,309[1,287 to 1,331]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#199 / 419
1,390[1,381 to 1,399]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#200 / 419
1,376[1,366 to 1,385]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#200 / 421
1,342[1,335 to 1,348]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#200 / 385
1,359[1,350 to 1,369]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#203 / 421
1,406[1,398 to 1,414]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#204 / 416
1,415[1,406 to 1,425]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#204 / 371
1,383[1,369 to 1,398]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#206 / 419
1,318[1,308 to 1,328]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#207 / 395
1,387[1,375 to 1,400]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#207 / 304
1,352[1,320 to 1,383]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#208 / 399
1,344[1,334 to 1,353]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#209 / 421
1,314[1,307 to 1,321]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#210 / 421
1,353[1,348 to 1,358]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#212 / 421
1,354[1,346 to 1,362]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#214 / 393
1,346[1,332 to 1,361]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#215 / 371
1,337[1,323 to 1,352]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#216 / 414
1,353[1,343 to 1,364]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#217 / 416
1,367[1,357 to 1,376]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#218 / 304
1,302[1,270 to 1,333]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#220 / 421
1,362[1,354 to 1,369]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#221 / 419
1,348[1,339 to 1,358]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#222 / 391
1,367[1,352 to 1,382]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#224 / 385
1,316[1,306 to 1,326]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#225 / 421
1,315[1,309 to 1,321]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#236 / 395
1,326[1,313 to 1,338]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#241 / 414
1,304[1,294 to 1,315]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#241 / 391
1,307[1,292 to 1,323]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#255 / 338
50.3%[44.8% to 55.9%]UnknownStandard27 Jan 2025

Closest head-to-head rivals

Direct pairwise win rates for o1-preview across shared benchmark boards.