Acropolis

Qwen3.5 397B A17B

AlibabaGrade B. Evidence grade B of A to D: good.Open weightsReleased 16 Feb 2026Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • Coding (1 boards): 33 (scale 0 to 100)Coding (1 boards)33
  • General text (2 boards): 80 (scale 0 to 100)General text (2 boards)80
  • Science (1 boards): 67 (scale 0 to 100)Science (1 boards)67
  • Vision (2 boards): 69 (scale 0 to 100)Vision (2 boards)69

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
LMArena Vision

LMArena · Entity recognition · Default

#14 / 52
1,271[1,234 to 1,307]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Captioning · Default

#15 / 34
1,227[1,170 to 1,284]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Captioning · Default

#23 / 34
1,171[1,114 to 1,229]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Entity recognition · Default

#24 / 52
1,218[1,181 to 1,255]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Homework · Default

#43 / 118
1,292[1,283 to 1,302]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Creative writing vision · Default

#46 / 106
1,262[1,249 to 1,275]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Humor · Default

#47 / 102
1,264[1,247 to 1,281]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Chinese · Default

#48 / 135
1,315[1,300 to 1,330]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Humor · Default

#48 / 102
1,244[1,227 to 1,261]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · English · Default

#49 / 167
1,269[1,262 to 1,276]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Creative writing vision · Default

#49 / 106
1,246[1,233 to 1,258]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Homework · Default

#49 / 118
1,287[1,278 to 1,297]UnknownStandard9 Nov 2026
LMArena Text

LMArena · Japanese · Default

#50 / 288
1,426[1,407 to 1,445]UnknownStandard11 Nov 2026
LMArena Vision

LMArena · Diagram · Default

#51 / 123
1,277[1,270 to 1,284]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · OCR · Default

#53 / 123
1,270[1,265 to 1,275]UnknownStandard9 Nov 2026
LMArena Vision

LMArena · Overall · Default

#54 / 167
1,262[1,257 to 1,268]UnknownStandard9 Nov 2026
LMArena Text

LMArena · Polish · Default

#55 / 243
1,448[1,434 to 1,462]UnknownStandard11 Nov 2026
LMArena Vision (style control)

LMArena · Chinese · Default

#55 / 135
1,291[1,276 to 1,306]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · English · Default

#55 / 167
1,251[1,243 to 1,258]UnknownStandard9 Nov 2026
LMArena Text

LMArena · French · Default

#57 / 301
1,464[1,451 to 1,476]UnknownStandard11 Nov 2026
LMArena Vision (style control)

LMArena · Diagram · Default

#57 / 123
1,273[1,266 to 1,281]UnknownStandard9 Nov 2026
LMArena Text

LMArena · Chinese · Default

#58 / 395
1,498[1,490 to 1,505]UnknownStandard11 Nov 2026
LMArena Vision (style control)

LMArena · OCR · Default

#58 / 123
1,260[1,255 to 1,265]UnknownStandard9 Nov 2026
LMArena Vision (style control)

LMArena · Overall · Default

#59 / 167
1,246[1,240 to 1,251]UnknownStandard9 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#64 / 391
1,455[1,448 to 1,463]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#66 / 288
1,428[1,409 to 1,447]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#67 / 320
1,443[1,427 to 1,459]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#67 / 395
1,496[1,488 to 1,504]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#68 / 414
1,435[1,430 to 1,441]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#69 / 419
1,457[1,452 to 1,463]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#71 / 404
1,453[1,445 to 1,462]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#74 / 402
1,452[1,444 to 1,461]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#74 / 421
1,430[1,426 to 1,434]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#75 / 371
1,462[1,456 to 1,469]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#75 / 304
1,444[1,432 to 1,456]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#77 / 301
1,471[1,459 to 1,483]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#78 / 421
1,462[1,458 to 1,466]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#78 / 399
1,442[1,438 to 1,446]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#80 / 419
1,445[1,439 to 1,450]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#80 / 404
1,450[1,441 to 1,458]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#81 / 421
1,433[1,429 to 1,437]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#82 / 421
1,448[1,444 to 1,451]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#83 / 416
1,463[1,459 to 1,468]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#83 / 421
1,438[1,434 to 1,441]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#83 / 371
1,478[1,471 to 1,484]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#84 / 421
1,424[1,420 to 1,428]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#84 / 289
1,391[1,375 to 1,407]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#84 / 385
1,431[1,425 to 1,438]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#85 / 393
1,442[1,435 to 1,450]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#85 / 391
1,467[1,459 to 1,474]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#86 / 420
1,415[1,411 to 1,420]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#86 / 414
1,447[1,441 to 1,452]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#87 / 419
1,465[1,460 to 1,471]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#87 / 399
1,453[1,449 to 1,458]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Polish · Default

#87 / 243
1,446[1,432 to 1,461]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#88 / 419
1,449[1,445 to 1,454]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#88 / 402
1,453[1,444 to 1,461]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#89 / 419
1,452[1,446 to 1,457]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#89 / 304
1,443[1,431 to 1,454]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#90 / 421
1,432[1,428 to 1,436]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#91 / 421
1,443[1,439 to 1,447]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#91 / 320
1,442[1,426 to 1,458]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#93 / 421
1,463[1,460 to 1,467]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#93 / 421
1,434[1,430 to 1,439]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · none

#95 / 338
86.4%[81.6% to 91.2%]UnknownStandard7 Aug 2026
LMArena Text

LMArena · Creative writing · Default

#96 / 419
1,402[1,397 to 1,408]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#96 / 289
1,391[1,375 to 1,407]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#97 / 416
1,490[1,486 to 1,495]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#97 / 420
1,421[1,416 to 1,426]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#97 / 421
1,441[1,438 to 1,444]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#99 / 421
1,440[1,436 to 1,444]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#99 / 419
1,466[1,462 to 1,471]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#99 / 421
1,480[1,476 to 1,484]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#101 / 338
85.9%[81% to 90.7%]UnknownStandard7 Aug 2026
LMArena Text (style control)

LMArena · English · Default

#101 / 421
1,449[1,445 to 1,453]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#101 / 385
1,437[1,431 to 1,443]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#102 / 393
1,447[1,440 to 1,455]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#103 / 419
1,398[1,393 to 1,403]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#103 / 419
1,406[1,401 to 1,412]UnknownStandard11 Nov 2026
LMArena WebDev

LMArena · Webdev react · Default

#103 / 140
1,387[1,381 to 1,393]UnknownStandard15 Nov 2026
LMArena WebDev

LMArena · Overall · Default

#104 / 156
1,400[1,395 to 1,405]UnknownStandard15 Nov 2026
LMArena WebDev

LMArena · Webdev · Default

#104 / 156
1,400[1,395 to 1,405]UnknownStandard15 Nov 2026
LMArena WebDev

LMArena · Webdev HTML · Default

#105 / 155
1,409[1,397 to 1,421]UnknownStandard15 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#108 / 419
1,403[1,398 to 1,408]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for Qwen3.5 397B A17B across shared benchmark boards.