Acropolis

Llama 3.1 Instruct 8B

MetaGrade B. Evidence grade B of A to D: good.Open weightsReleased 23 Jul 2024Consistent across benchmarks
Compare with peers

Domain profile

Median within-board percentile by capability domain across boards with sufficient peer overlap.

  • General text (2 boards): 21 (scale 0 to 100)General text (2 boards)21
  • Science (1 boards): 6 (scale 0 to 100)Science (1 boards)6

Benchmark appearances

Best verified run per board, with confidence intervals and Pareto frontier status.

BenchmarkRankScoreCostStatusObserved
LMArena Text

LMArena · Japanese · Default

#260 / 288
1,061[1,042 to 1,081]UnknownStandard11 Nov 2026
LMArena Text

LMArena · French · Default

#263 / 301
1,177[1,147 to 1,207]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Korean · Default

#266 / 289
1,053[1,029 to 1,077]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Japanese · Default

#266 / 288
1,087[1,067 to 1,107]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Spanish · Default

#270 / 304
1,169[1,142 to 1,196]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Korean · Default

#277 / 289
1,087[1,062 to 1,111]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · French · Default

#279 / 301
1,207[1,177 to 1,237]UnknownStandard11 Nov 2026
LMArena Text

LMArena · German · Default

#281 / 320
1,144[1,126 to 1,162]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Spanish · Default

#285 / 304
1,189[1,161 to 1,217]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · German · Default

#288 / 320
1,168[1,150 to 1,186]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry medicine and healthcare · Default

#314 / 391
1,182[1,168 to 1,195]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry legal and government · Default

#318 / 393
1,206[1,194 to 1,219]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Expert · Default

#320 / 371
1,144[1,132 to 1,156]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Math · Default

#322 / 404
1,179[1,171 to 1,187]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Coding · Default

#323 / 416
1,195[1,187 to 1,202]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts English · Default

#323 / 419
1,196[1,188 to 1,203]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry mathematical · Default

#323 / 402
1,180[1,172 to 1,189]UnknownStandard11 Nov 2026
GPQA diamond

Epoch AI Benchmarking Hub · Default

#325 / 338
27%[23.3% to 30.6%]UnknownStandard27 Aug 2026
LMArena Text

LMArena · English · Default

#325 / 421
1,218[1,212 to 1,223]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry software and IT services · Default

#325 / 421
1,195[1,188 to 1,201]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Hard prompts · Default

#326 / 421
1,175[1,169 to 1,181]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry business and management and financial operations · Default

#326 / 414
1,166[1,157 to 1,175]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Chinese · Default

#327 / 395
1,151[1,140 to 1,161]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry life and physical and social science · Default

#327 / 419
1,193[1,185 to 1,201]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Multi turn · Default

#329 / 419
1,172[1,164 to 1,180]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Longer query · Default

#330 / 399
1,181[1,173 to 1,189]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry entertainment and sports and media · Default

#332 / 419
1,145[1,137 to 1,152]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Overall · Default

#332 / 421
1,187[1,183 to 1,191]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Exclude ties · Default

#333 / 421
1,055[1,048 to 1,062]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Instruction following · Default

#333 / 421
1,159[1,153 to 1,164]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Non English · Default

#333 / 421
1,148[1,143 to 1,153]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry medicine and healthcare · Default

#333 / 391
1,231[1,218 to 1,244]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Creative writing · Default

#334 / 419
1,154[1,146 to 1,162]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Russian · Default

#334 / 385
1,158[1,150 to 1,167]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry legal and government · Default

#334 / 393
1,246[1,234 to 1,259]UnknownStandard11 Nov 2026
LMArena Text

LMArena · Industry writing and literature and language · Default

#336 / 420
1,162[1,155 to 1,169]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Multi turn · Default

#338 / 419
1,198[1,191 to 1,206]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Expert · Default

#339 / 371
1,198[1,186 to 1,210]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Longer query · Default

#339 / 399
1,224[1,216 to 1,232]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Russian · Default

#340 / 385
1,190[1,181 to 1,198]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Coding · Default

#342 / 416
1,260[1,252 to 1,267]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry business and management and financial operations · Default

#342 / 414
1,210[1,201 to 1,219]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry software and IT services · Default

#342 / 421
1,244[1,238 to 1,251]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Chinese · Default

#343 / 395
1,204[1,193 to 1,215]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Math · Default

#344 / 404
1,188[1,180 to 1,196]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts English · Default

#345 / 419
1,239[1,231 to 1,246]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry mathematical · Default

#345 / 402
1,193[1,184 to 1,201]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry entertainment and sports and media · Default

#346 / 419
1,174[1,166 to 1,182]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry life and physical and social science · Default

#346 / 419
1,229[1,221 to 1,237]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Non English · Default

#346 / 421
1,178[1,173 to 1,183]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Creative writing · Default

#347 / 419
1,177[1,169 to 1,185]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Exclude ties · Default

#348 / 421
1,089[1,083 to 1,096]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Hard prompts · Default

#348 / 421
1,222[1,216 to 1,229]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Overall · Default

#348 / 421
1,211[1,207 to 1,215]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · English · Default

#349 / 421
1,237[1,232 to 1,242]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Industry writing and literature and language · Default

#349 / 420
1,182[1,175 to 1,189]UnknownStandard11 Nov 2026
LMArena Text (style control)

LMArena · Instruction following · Default

#349 / 421
1,191[1,185 to 1,196]UnknownStandard11 Nov 2026

Closest head-to-head rivals

Direct pairwise win rates for Llama 3.1 Instruct 8B across shared benchmark boards.