Acropolis

Claude 3.5 Sonnet (Oct '24)

AnthropicGrade A. Evidence grade A of A to D: strongest.ProprietaryReleased 22 Oct 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Agentic (1 boards): 32 (scale 0 to 100)Agentic (1 boards)32
  • Coding (1 boards): 32 (scale 0 to 100)Coding (1 boards)32
  • General text (3 boards): 42 (scale 0 to 100)General text (3 boards)42
  • Math (2 boards): 14 (scale 0 to 100)Math (2 boards)14
  • Science (2 boards): 20 (scale 0 to 100)Science (2 boards)20
  • Vision (2 boards): 32 (scale 0 to 100)Vision (2 boards)32

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
METR time horizon

METR time horizons · metr_agents/react

#16 / 23Tied #1
20.5 min[10.1 min to 40.8 min]UnknownStandardNot stated
HLE

Epoch AI Benchmarking Hub · Default

#54 / 56
4.1%[2.6% to 5.6%]UnknownStandardNot stated
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#84 / 101
2.1%[0.4% to 3.7%]UnknownStandard6 Mar 2025
LMArena Vision (style control)

LMArena · Chinese · Default

#105 / 135
1,165[1,126 to 1,203]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · OCR · Default

#105 / 123
1,181[1,162 to 1,200]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Diagram · Default

#106 / 123
1,186[1,154 to 1,219]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Homework · Default

#107 / 118
1,172[1,133 to 1,211]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#111 / 135
1,118[1,080 to 1,157]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#111 / 167
1,161[1,153 to 1,169]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Diagram · Default

#117 / 123
1,134[1,102 to 1,166]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Homework · Default

#117 / 118
1,137[1,098 to 1,176]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · OCR · Default

#118 / 123
1,139[1,120 to 1,159]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#120 / 167
1,154[1,143 to 1,164]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#126 / 167
1,125[1,118 to 1,133]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#128 / 167
1,124[1,113 to 1,134]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#153 / 243
1,385[1,371 to 1,399]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#159 / 320
1,381[1,367 to 1,395]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#160 / 419
1,371[1,365 to 1,377]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#166 / 419
1,365[1,360 to 1,371]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#169 / 420
1,378[1,373 to 1,383]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#170 / 288
1,310[1,296 to 1,325]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#178 / 416
1,436[1,430 to 1,441]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#179 / 301
1,392[1,371 to 1,413]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#181 / 399
1,397[1,391 to 1,402]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#182 / 385
1,376[1,369 to 1,383]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#185 / 289
1,305[1,286 to 1,323]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#185 / 419
1,390[1,384 to 1,396]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#189 / 421
1,374[1,369 to 1,378]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#190 / 304
1,369[1,349 to 1,388]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#195 / 421
1,399[1,395 to 1,403]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#196 / 419
1,404[1,399 to 1,409]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#197 / 421
1,359[1,355 to 1,363]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#199 / 288
1,234[1,220 to 1,248]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#199 / 421
1,346[1,342 to 1,350]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#199 / 421
1,374[1,371 to 1,378]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#200 / 393
1,383[1,374 to 1,392]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#201 / 421
1,408[1,403 to 1,412]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#206 / 320
1,297[1,284 to 1,311]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#206 / 421
1,383[1,379 to 1,387]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#207 / 391
1,384[1,374 to 1,394]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#208 / 371
1,373[1,363 to 1,382]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Polish · Default

#210 / 243
1,288[1,274 to 1,301]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#213 / 301
1,304[1,283 to 1,326]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#213 / 419
1,376[1,370 to 1,382]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#215 / 414
1,354[1,348 to 1,360]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#216 / 402
1,361[1,354 to 1,368]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#217 / 404
1,352[1,346 to 1,359]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#221 / 420
1,314[1,309 to 1,319]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#223 / 395
1,369[1,361 to 1,378]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#226 / 289
1,198[1,179 to 1,216]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#226 / 304
1,286[1,266 to 1,305]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#229 / 419
1,326[1,320 to 1,331]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#230 / 419
1,292[1,286 to 1,298]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#232 / 385
1,305[1,299 to 1,312]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#235 / 416
1,342[1,337 to 1,348]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#236 / 404
1,307[1,300 to 1,313]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#239 / 402
1,307[1,300 to 1,314]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#240 / 419
1,279[1,273 to 1,285]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#243 / 421
1,297[1,293 to 1,301]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#243 / 399
1,311[1,305 to 1,317]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#244 / 338
55.3%[49.8% to 60.8%]UnknownStandard27 Jan 2025
LMArena Text

LMArena · Hard prompts · Default

#247 / 421
1,305[1,301 to 1,309]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#248 / 421
1,283[1,279 to 1,287]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#250 / 421
1,316[1,311 to 1,320]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#251 / 371
1,264[1,255 to 1,273]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#253 / 419
1,311[1,306 to 1,317]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#256 / 421
1,298[1,295 to 1,301]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#257 / 421
1,236[1,232 to 1,240]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#263 / 395
1,272[1,264 to 1,280]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#263 / 421
1,307[1,303 to 1,311]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#272 / 414
1,255[1,248 to 1,261]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#276 / 393
1,277[1,268 to 1,286]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#277 / 391
1,257[1,247 to 1,266]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#284 / 419
1,270[1,264 to 1,276]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for Claude 3.5 Sonnet (Oct '24) across shared benchmark boards.