Acropolis

Claude 3.5 Haiku

AnthropicGrade B. Evidence grade B of A to D: good.ProprietaryConsistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • General text (2 boards): 36 (scale 0 to 100)General text (2 boards)36
  • Math (1 boards): 5 (scale 0 to 100)Math (1 boards)5
  • Science (1 boards): 17 (scale 0 to 100)Science (1 boards)17
  • Vision (2 boards): 24 (scale 0 to 100)Vision (2 boards)24

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#96 / 101
0.3%[0% to 2.4%]UnknownStandard7 Mar 2025
LMArena Vision (style control)

LMArena · Homework · Default

#117 / 118
1,148[1,108 to 1,187]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Homework · Default

#118 / 118
1,117[1,078 to 1,157]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Diagram · Default

#120 / 123
1,131[1,097 to 1,164]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · OCR · Default

#121 / 123
1,132[1,112 to 1,152]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Diagram · Default

#122 / 123
1,075[1,042 to 1,108]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · OCR · Default

#122 / 123
1,090[1,070 to 1,110]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#128 / 167
1,127[1,111 to 1,143]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#132 / 167
1,092[1,076 to 1,108]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#135 / 167
1,116[1,093 to 1,139]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#137 / 167
1,087[1,063 to 1,110]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#195 / 243
1,339[1,326 to 1,352]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#209 / 289
1,269[1,250 to 1,287]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#211 / 288
1,243[1,227 to 1,260]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#212 / 320
1,312[1,296 to 1,327]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#215 / 301
1,344[1,322 to 1,366]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#220 / 304
1,333[1,312 to 1,353]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Polish · Default

#225 / 243
1,249[1,237 to 1,262]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#228 / 288
1,175[1,159 to 1,192]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#231 / 393
1,352[1,342 to 1,362]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#231 / 399
1,346[1,340 to 1,352]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#232 / 419
1,305[1,299 to 1,310]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#233 / 419
1,305[1,299 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#234 / 416
1,386[1,380 to 1,392]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#238 / 289
1,173[1,155 to 1,192]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#238 / 304
1,261[1,241 to 1,281]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#239 / 301
1,264[1,242 to 1,286]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#240 / 420
1,314[1,309 to 1,319]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#241 / 391
1,346[1,335 to 1,357]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#241 / 419
1,328[1,322 to 1,334]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#243 / 421
1,365[1,360 to 1,370]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#244 / 385
1,319[1,312 to 1,327]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#245 / 421
1,345[1,341 to 1,350]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#245 / 421
1,316[1,311 to 1,321]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#246 / 320
1,236[1,221 to 1,252]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#247 / 419
1,355[1,349 to 1,361]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#249 / 421
1,308[1,304 to 1,312]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#253 / 419
1,342[1,336 to 1,348]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#254 / 371
1,316[1,305 to 1,326]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#257 / 421
1,270[1,265 to 1,275]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#257 / 421
1,325[1,321 to 1,328]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#261 / 414
1,315[1,308 to 1,322]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#263 / 395
1,322[1,313 to 1,332]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#266 / 402
1,301[1,293 to 1,309]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#268 / 421
1,335[1,331 to 1,340]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#270 / 404
1,287[1,279 to 1,294]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#275 / 416
1,286[1,280 to 1,292]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#280 / 385
1,253[1,245 to 1,260]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#284 / 399
1,260[1,254 to 1,266]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#285 / 402
1,249[1,241 to 1,257]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#285 / 420
1,256[1,251 to 1,261]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#285 / 404
1,244[1,236 to 1,251]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#285 / 419
1,265[1,259 to 1,271]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#288 / 421
1,272[1,267 to 1,277]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#289 / 391
1,228[1,217 to 1,238]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#289 / 421
1,238[1,234 to 1,242]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#290 / 419
1,264[1,258 to 1,270]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#290 / 393
1,259[1,249 to 1,269]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#290 / 421
1,240[1,236 to 1,245]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#291 / 395
1,229[1,220 to 1,238]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#291 / 371
1,207[1,197 to 1,218]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#291 / 421
1,251[1,246 to 1,255]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#291 / 419
1,224[1,218 to 1,230]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#293 / 419
1,232[1,226 to 1,239]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#296 / 338
38.1%[33% to 43.3%]UnknownStandard12 Mar 2025
LMArena Text

LMArena · Industry business and management and financial operations · Default

#296 / 414
1,223[1,216 to 1,229]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#297 / 421
1,171[1,166 to 1,176]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#298 / 421
1,255[1,252 to 1,259]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#299 / 421
1,267[1,263 to 1,272]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#301 / 419
1,247[1,241 to 1,253]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for Claude 3.5 Haiku across shared benchmark boards.