Acropolis

Claude 3.5 Sonnet (June '24)

AnthropicGrade A. Evidence grade A of A to D: strongest.ProprietaryReleased 21 Jun 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Agentic (1 boards): 23 (scale 0 to 100)Agentic (1 boards)23
  • Coding (1 boards): 23 (scale 0 to 100)Coding (1 boards)23
  • General text (2 boards): 42 (scale 0 to 100)General text (2 boards)42
  • Math (1 boards): 14 (scale 0 to 100)Math (1 boards)14
  • Science (1 boards): 35 (scale 0 to 100)Science (1 boards)35
  • Vision (2 boards): 28 (scale 0 to 100)Vision (2 boards)28

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
METR time horizon

METR time horizons · metr_agents/react

#18 / 23Tied #1
11.4 min[5.5 min to 22.4 min]UnknownStandardNot stated
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#90 / 101
1%[0.3% to 3.2%]UnknownStandard7 Mar 2025
LMArena Vision (style control)

LMArena · Chinese · Default

#113 / 135
1,127[1,087 to 1,166]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#114 / 135
1,105[1,066 to 1,144]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#121 / 167
1,146[1,136 to 1,156]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#128 / 167
1,120[1,110 to 1,130]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#129 / 167
1,136[1,123 to 1,149]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#130 / 167
1,119[1,106 to 1,132]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#149 / 243
1,389[1,319 to 1,458]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Polish · Default

#185 / 243
1,328[1,260 to 1,396]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#188 / 288
1,285[1,269 to 1,302]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#191 / 289
1,290[1,270 to 1,310]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#194 / 320
1,334[1,318 to 1,349]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#198 / 301
1,363[1,339 to 1,387]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#200 / 288
1,231[1,215 to 1,247]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#206 / 304
1,352[1,330 to 1,375]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#215 / 419
1,350[1,342 to 1,357]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#216 / 385
1,345[1,337 to 1,354]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#217 / 416
1,399[1,392 to 1,406]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#218 / 301
1,293[1,270 to 1,317]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#221 / 399
1,355[1,348 to 1,363]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#221 / 421
1,332[1,328 to 1,337]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#222 / 320
1,271[1,256 to 1,286]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#222 / 420
1,331[1,325 to 1,337]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#224 / 304
1,289[1,267 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#224 / 404
1,342[1,335 to 1,350]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#225 / 289
1,201[1,181 to 1,220]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#225 / 419
1,312[1,304 to 1,319]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#225 / 421
1,338[1,333 to 1,343]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#229 / 421
1,361[1,356 to 1,367]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#229 / 393
1,354[1,343 to 1,365]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#230 / 402
1,340[1,332 to 1,348]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#231 / 371
1,344[1,333 to 1,356]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#234 / 421
1,343[1,340 to 1,347]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#236 / 419
1,304[1,297 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#237 / 421
1,297[1,292 to 1,302]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#238 / 419
1,367[1,361 to 1,374]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#238 / 419
1,357[1,349 to 1,364]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#238 / 391
1,350[1,338 to 1,361]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#239 / 421
1,373[1,367 to 1,379]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#240 / 404
1,303[1,296 to 1,311]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#243 / 395
1,346[1,337 to 1,356]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#246 / 338
54%[48.6% to 59.4%]UnknownStandard27 Jan 2025
LMArena Text

LMArena · Industry mathematical · Default

#248 / 402
1,294[1,286 to 1,302]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#250 / 419
1,299[1,292 to 1,306]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#251 / 421
1,349[1,344 to 1,353]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#251 / 414
1,321[1,313 to 1,329]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#252 / 385
1,282[1,274 to 1,290]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#258 / 420
1,280[1,274 to 1,286]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#259 / 421
1,270[1,265 to 1,275]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#260 / 416
1,306[1,299 to 1,313]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#261 / 421
1,269[1,264 to 1,275]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#263 / 371
1,247[1,236 to 1,258]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#265 / 395
1,265[1,255 to 1,274]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#266 / 421
1,275[1,270 to 1,281]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#272 / 419
1,282[1,276 to 1,289]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#274 / 399
1,275[1,267 to 1,282]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#275 / 421
1,288[1,282 to 1,294]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#276 / 421
1,281[1,278 to 1,284]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#277 / 421
1,206[1,201 to 1,211]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#280 / 419
1,239[1,231 to 1,246]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#283 / 419
1,270[1,263 to 1,277]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#283 / 391
1,245[1,233 to 1,256]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#285 / 421
1,287[1,283 to 1,292]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#285 / 393
1,266[1,255 to 1,277]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#286 / 419
1,238[1,230 to 1,246]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#287 / 414
1,235[1,227 to 1,243]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for Claude 3.5 Sonnet (June '24) across shared benchmark boards.