Acropolis

Claude 3.7 Sonnet

AnthropicGrade A. Evidence grade A of A to D: strongest.ProprietaryReleased 24 Feb 2025Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Agentic (3 boards): 41 (scale 0 to 100)Agentic (3 boards)41
  • Coding (2 boards): 27 (scale 0 to 100)Coding (2 boards)27
  • General text (4 boards): 36 (scale 0 to 100)General text (4 boards)36
  • Math (2 boards): 28 (scale 0 to 100)Math (2 boards)28
  • Science (3 boards): 27 (scale 0 to 100)Science (3 boards)27
  • Vision (3 boards): 43 (scale 0 to 100)Vision (3 boards)43

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
OSWorld

Epoch AI Benchmarking Hub · Default

#13 / 38
35.8%UnknownStandardNot stated
METR time horizon

METR time horizons · metr_agents/react

#14 / 23Tied #1
60.4 min[33 min to 104.2 min]UnknownStandardNot stated
OSWorld

Epoch AI Benchmarking Hub · Default

#14 / 38
35.6%UnknownStandardNot stated
OSWorld

Epoch AI Benchmarking Hub · Default

#24 / 38
27.1%UnknownStandardNot stated
SWE-Bench verified

Epoch AI Benchmarking Hub · Default

#31 / 35
61%[56.6% to 65.3%]UnknownStandard4 Feb 2026
HLE

Epoch AI Benchmarking Hub · thinking

#39 / 56
8%[5.9% to 10.1%]UnknownStandardNot stated
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#72 / 101
4.1%[1.8% to 6.4%]UnknownStandard6 Mar 2025
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#78 / 101
3.4%[1.3% to 5.6%]UnknownStandard13 Mar 2025
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#79 / 101
3.1%[1.1% to 5.1%]UnknownStandard13 Mar 2025
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#79 / 101
3.1%[1.1% to 5.1%]UnknownStandard6 Mar 2025
LMArena Vision (style control)

LMArena · Homework · Default

#91 / 118
1,230[1,193 to 1,267]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · OCR · thinking

#95 / 123
1,210[1,191 to 1,230]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Diagram · thinking

#96 / 123
1,213[1,180 to 1,246]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Chinese · Default

#97 / 135
1,200[1,153 to 1,247]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Homework · thinking

#97 / 118
1,215[1,173 to 1,257]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Homework · Default

#98 / 118
1,207[1,170 to 1,244]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · thinking

#98 / 167
1,193[1,177 to 1,208]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Homework · thinking

#100 / 118
1,193[1,150 to 1,235]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#102 / 135
1,174[1,127 to 1,221]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · OCR · thinking

#102 / 123
1,180[1,161 to 1,200]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Diagram · Default

#102 / 123
1,194[1,162 to 1,227]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · OCR · Default

#103 / 123
1,187[1,168 to 1,207]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · thinking

#104 / 167
1,185[1,162 to 1,207]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#107 / 167
1,175[1,166 to 1,185]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Diagram · thinking

#108 / 123
1,174[1,141 to 1,207]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · thinking

#110 / 167
1,168[1,153 to 1,184]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Diagram · Default

#111 / 123
1,153[1,121 to 1,185]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · OCR · Default

#111 / 123
1,157[1,137 to 1,176]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · thinking

#115 / 167
1,163[1,141 to 1,186]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#118 / 167
1,162[1,149 to 1,174]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#120 / 167
1,151[1,141 to 1,160]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · thinking

#121 / 419
1,393[1,385 to 1,402]UnknownStandard11 Nov 2026
LMArena Vision

LMArena · English · Default

#127 / 167
1,141[1,128 to 1,153]UnknownStandard9 Nov 2026
LMArena Text (style control)

LMArena · Longer query · thinking

#132 / 399
1,430[1,422 to 1,437]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · thinking

#134 / 421
1,411[1,405 to 1,418]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · thinking

#138 / 419
1,386[1,378 to 1,393]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · thinking

#141 / 420
1,394[1,387 to 1,401]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · thinking

#146 / 288
1,343[1,323 to 1,362]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#149 / 338
79.7%[74.5% to 84.9%]UnknownStandard26 May 2025
LMArena Text (style control)

LMArena · German · thinking

#150 / 320
1,386[1,367 to 1,405]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#151 / 419
1,377[1,369 to 1,385]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#152 / 288
1,333[1,314 to 1,353]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · thinking

#159 / 416
1,452[1,444 to 1,460]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#159 / 399
1,412[1,405 to 1,420]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Polish · thinking

#160 / 243
1,376[1,362 to 1,390]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#161 / 419
1,371[1,364 to 1,379]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#163 / 243
1,371[1,356 to 1,385]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · thinking

#164 / 289
1,332[1,309 to 1,355]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#165 / 338
76.8%[70.9% to 82.7%]UnknownStandard10 Mar 2025
GPQA diamond

Epoch AI Benchmarking Hub · Default

#165 / 338
76.8%[70.9% to 82.7%]UnknownStandard26 Feb 2025
LMArena Text (style control)

LMArena · Korean · Default

#166 / 289
1,327[1,304 to 1,350]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · thinking

#167 / 419
1,427[1,420 to 1,435]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#167 / 420
1,379[1,372 to 1,385]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#170 / 320
1,364[1,345 to 1,383]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · thinking

#170 / 421
1,418[1,413 to 1,424]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · thinking

#170 / 419
1,400[1,392 to 1,408]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · thinking

#171 / 371
1,412[1,398 to 1,425]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#171 / 419
1,399[1,391 to 1,407]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#172 / 421
1,385[1,379 to 1,391]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · thinking

#176 / 391
1,409[1,396 to 1,422]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · thinking

#179 / 304
1,378[1,353 to 1,402]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · thinking

#180 / 393
1,397[1,384 to 1,409]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · thinking

#180 / 385
1,378[1,368 to 1,388]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · thinking

#181 / 288
1,267[1,247 to 1,287]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · thinking

#182 / 421
1,368[1,362 to 1,373]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · thinking

#182 / 402
1,394[1,383 to 1,406]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · thinking

#183 / 399
1,373[1,365 to 1,381]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · thinking

#184 / 421
1,402[1,397 to 1,408]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#184 / 301
1,386[1,360 to 1,412]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · thinking

#184 / 421
1,388[1,384 to 1,393]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · thinking

#185 / 421
1,368[1,363 to 1,374]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#186 / 288
1,260[1,241 to 1,280]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#187 / 393
1,394[1,382 to 1,407]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · thinking

#187 / 404
1,386[1,375 to 1,397]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#187 / 385
1,374[1,364 to 1,384]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · thinking

#188 / 419
1,402[1,394 to 1,410]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · thinking

#191 / 421
1,352[1,345 to 1,358]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#191 / 416
1,431[1,424 to 1,439]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · thinking

#191 / 301
1,377[1,349 to 1,404]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · thinking

#191 / 421
1,417[1,411 to 1,424]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · thinking

#194 / 419
1,332[1,323 to 1,340]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#194 / 421
1,399[1,394 to 1,405]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#195 / 419
1,406[1,399 to 1,413]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#198 / 421
1,347[1,342 to 1,353]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#198 / 371
1,391[1,378 to 1,404]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · thinking

#199 / 420
1,338[1,331 to 1,344]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#199 / 399
1,355[1,347 to 1,362]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#199 / 304
1,365[1,340 to 1,389]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · thinking

#200 / 395
1,391[1,378 to 1,403]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#200 / 421
1,357[1,352 to 1,362]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#201 / 421
1,385[1,380 to 1,390]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#202 / 421
1,407[1,401 to 1,413]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#202 / 421
1,373[1,369 to 1,376]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · thinking

#203 / 289
1,249[1,226 to 1,272]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · thinking

#204 / 320
1,300[1,281 to 1,320]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#204 / 414
1,367[1,358 to 1,375]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#204 / 419
1,385[1,377 to 1,392]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#204 / 404
1,364[1,354 to 1,374]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#206 / 289
1,239[1,215 to 1,263]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · thinking

#208 / 419
1,313[1,306 to 1,321]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · thinking

#209 / 414
1,363[1,354 to 1,371]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#211 / 419
1,317[1,308 to 1,325]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#212 / 402
1,365[1,354 to 1,375]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#212 / 391
1,378[1,365 to 1,392]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#213 / 420
1,324[1,317 to 1,330]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Polish · thinking

#213 / 243
1,284[1,270 to 1,298]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#213 / 395
1,382[1,370 to 1,394]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#214 / 320
1,281[1,262 to 1,300]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#214 / 421
1,324[1,318 to 1,330]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Polish · Default

#214 / 243
1,278[1,264 to 1,292]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#215 / 338
66%[60.8% to 71.3%]UnknownStandard24 Feb 2025
LMArena Text

LMArena · French · Default

#215 / 301
1,302[1,275 to 1,328]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#219 / 419
1,339[1,331 to 1,347]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · thinking

#219 / 304
1,299[1,274 to 1,324]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · thinking

#220 / 301
1,289[1,261 to 1,317]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#220 / 419
1,300[1,293 to 1,307]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · thinking

#222 / 404
1,336[1,326 to 1,347]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · thinking

#222 / 419
1,337[1,329 to 1,345]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#222 / 304
1,290[1,265 to 1,315]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · thinking

#223 / 416
1,361[1,353 to 1,368]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · thinking

#224 / 402
1,339[1,328 to 1,351]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#225 / 404
1,319[1,309 to 1,329]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · thinking

#226 / 371
1,320[1,307 to 1,334]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · thinking

#228 / 385
1,311[1,301 to 1,321]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · thinking

#229 / 421
1,333[1,327 to 1,339]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#230 / 385
1,310[1,300 to 1,320]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · thinking

#234 / 419
1,340[1,332 to 1,347]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#235 / 402
1,314[1,303 to 1,324]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#237 / 416
1,339[1,332 to 1,346]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#237 / 371
1,301[1,288 to 1,314]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#241 / 421
1,315[1,309 to 1,321]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · thinking

#241 / 421
1,296[1,291 to 1,301]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · thinking

#244 / 421
1,261[1,255 to 1,266]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · thinking

#245 / 421
1,324[1,317 to 1,330]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#245 / 421
1,286[1,281 to 1,291]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · thinking

#245 / 421
1,314[1,310 to 1,319]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · thinking

#248 / 395
1,299[1,286 to 1,312]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · thinking

#249 / 421
1,326[1,321 to 1,332]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#249 / 419
1,320[1,313 to 1,327]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#250 / 395
1,297[1,285 to 1,310]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#252 / 421
1,241[1,235 to 1,246]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#252 / 421
1,314[1,308 to 1,320]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#253 / 421
1,299[1,295 to 1,303]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · thinking

#255 / 393
1,302[1,289 to 1,314]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#256 / 393
1,300[1,288 to 1,313]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · thinking

#256 / 391
1,288[1,275 to 1,302]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#257 / 414
1,273[1,264 to 1,281]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · thinking

#259 / 414
1,269[1,260 to 1,277]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#260 / 421
1,310[1,305 to 1,315]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · thinking

#260 / 419
1,298[1,290 to 1,306]UnknownStandard11 Nov 2026
ARC-AGI-2

Epoch AI Benchmarking Hub · Default

#266 / 299
0.9%$0.36StandardNot stated
LMArena Text

LMArena · Industry life and physical and social science · Default

#273 / 419
1,285[1,277 to 1,293]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#275 / 391
1,258[1,245 to 1,272]UnknownStandard11 Nov 2026
ARC-AGI-2

Epoch AI Benchmarking Hub · Default

#276 / 299
0.7%$0.51StandardNot stated
ARC-AGI-2

Epoch AI Benchmarking Hub · Default

#280 / 299
0.4%$0.14StandardNot stated
ARC-AGI-2

Epoch AI Benchmarking Hub · Default

#281 / 299
0%$0.12StandardNot stated

Closest head-to-head rivals

Direct pairwise win rates for Claude 3.7 Sonnet across shared benchmark boards.