Acropolis

Mistral Large (2411)

MistralGrade B. Evidence grade B of A to D: good.Open weightsReleased 18 Nov 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • General text (2 boards): 34 (scale 0 to 100)General text (2 boards)34
  • Math (1 boards): 5 (scale 0 to 100)Math (1 boards)5
  • Science (1 boards): 33 (scale 0 to 100)Science (1 boards)33

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
FrontierMath-2025-02-28-Private

Epoch AI Benchmarking Hub · Default

#96 / 101
0.3%[0% to 2.4%]UnknownStandard6 Mar 2025
LMArena Text (style control)

LMArena · French · Default

#193 / 301
1,374[1,334 to 1,414]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#207 / 301
1,325[1,284 to 1,366]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#217 / 289
1,260[1,229 to 1,290]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#223 / 289
1,202[1,172 to 1,232]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Japanese · Default

#230 / 288
1,170[1,148 to 1,193]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#233 / 288
1,214[1,191 to 1,237]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#237 / 304
1,268[1,222 to 1,313]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#238 / 320
1,285[1,262 to 1,307]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#238 / 304
1,308[1,262 to 1,353]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#245 / 320
1,242[1,219 to 1,264]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#252 / 338
51.3%[46.1% to 56.6%]UnknownStandard25 Feb 2025
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#267 / 420
1,298[1,291 to 1,305]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#273 / 385
1,296[1,286 to 1,306]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#274 / 421
1,295[1,289 to 1,301]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#274 / 404
1,282[1,273 to 1,292]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#275 / 419
1,276[1,267 to 1,285]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#275 / 393
1,326[1,311 to 1,341]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#275 / 391
1,318[1,301 to 1,334]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#276 / 404
1,261[1,252 to 1,270]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#276 / 419
1,271[1,263 to 1,280]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#278 / 391
1,255[1,238 to 1,271]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#278 / 420
1,260[1,253 to 1,268]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#279 / 393
1,275[1,260 to 1,290]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#280 / 402
1,257[1,247 to 1,267]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#280 / 419
1,293[1,284 to 1,302]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#281 / 419
1,242[1,233 to 1,251]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#282 / 416
1,275[1,267 to 1,284]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#282 / 421
1,249[1,243 to 1,255]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#282 / 385
1,251[1,241 to 1,262]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#282 / 416
1,346[1,337 to 1,355]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#282 / 421
1,313[1,306 to 1,320]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#282 / 402
1,284[1,274 to 1,294]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#283 / 399
1,261[1,252 to 1,271]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#284 / 421
1,257[1,250 to 1,264]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#284 / 414
1,294[1,283 to 1,304]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#285 / 395
1,239[1,226 to 1,253]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#285 / 419
1,268[1,259 to 1,276]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#285 / 414
1,238[1,227 to 1,249]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#285 / 421
1,306[1,301 to 1,310]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#286 / 419
1,230[1,222 to 1,239]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#286 / 421
1,274[1,267 to 1,281]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#286 / 421
1,321[1,316 to 1,327]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#286 / 399
1,305[1,296 to 1,315]UnknownStandard11 Nov 2026
LMArena Text

LMArena · English · Default

#287 / 421
1,284[1,279 to 1,289]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#287 / 419
1,260[1,251 to 1,269]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#287 / 395
1,297[1,284 to 1,311]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#287 / 419
1,323[1,314 to 1,332]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#287 / 421
1,333[1,326 to 1,341]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#288 / 421
1,278[1,272 to 1,284]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#289 / 421
1,265[1,261 to 1,270]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#290 / 371
1,208[1,193 to 1,223]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#290 / 421
1,237[1,230 to 1,244]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#291 / 421
1,179[1,173 to 1,186]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#291 / 419
1,260[1,252 to 1,269]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#291 / 419
1,315[1,306 to 1,323]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#293 / 371
1,271[1,256 to 1,286]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#295 / 421
1,235[1,229 to 1,241]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for Mistral Large (2411) across shared benchmark boards.