Consensus score
8.4
95% interval 0.0 to 24.2
8.4
95% interval 0.0 to 24.2
19th
IQR spread 8.3 pct
57
Across 2 domains
2
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| LMArena Text LMArena · Japanese · Default | #260 / 288 | 1,061[1,042 to 1,081] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #263 / 301 | 1,177[1,147 to 1,207] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #266 / 289 | 1,053[1,029 to 1,077] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #266 / 288 | 1,087[1,067 to 1,107] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #270 / 304 | 1,169[1,142 to 1,196] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #277 / 289 | 1,087[1,062 to 1,111] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #279 / 301 | 1,207[1,177 to 1,237] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #281 / 320 | 1,144[1,126 to 1,162] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #285 / 304 | 1,189[1,161 to 1,217] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #288 / 320 | 1,168[1,150 to 1,186] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #314 / 391 | 1,182[1,168 to 1,195] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #318 / 393 | 1,206[1,194 to 1,219] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #320 / 371 | 1,144[1,132 to 1,156] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #322 / 404 | 1,179[1,171 to 1,187] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #323 / 416 | 1,195[1,187 to 1,202] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #323 / 419 | 1,196[1,188 to 1,203] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #323 / 402 | 1,180[1,172 to 1,189] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #325 / 338 | 27%[23.3% to 30.6%] | Unknown | Standard | 27 Aug 2026 |
| LMArena Text LMArena · English · Default | #325 / 421 | 1,218[1,212 to 1,223] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #325 / 421 | 1,195[1,188 to 1,201] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #326 / 421 | 1,175[1,169 to 1,181] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #326 / 414 | 1,166[1,157 to 1,175] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #327 / 395 | 1,151[1,140 to 1,161] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #327 / 419 | 1,193[1,185 to 1,201] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #329 / 419 | 1,172[1,164 to 1,180] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #330 / 399 | 1,181[1,173 to 1,189] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #332 / 419 | 1,145[1,137 to 1,152] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #332 / 421 | 1,187[1,183 to 1,191] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #333 / 421 | 1,055[1,048 to 1,062] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #333 / 421 | 1,159[1,153 to 1,164] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #333 / 421 | 1,148[1,143 to 1,153] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #333 / 391 | 1,231[1,218 to 1,244] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #334 / 419 | 1,154[1,146 to 1,162] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #334 / 385 | 1,158[1,150 to 1,167] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #334 / 393 | 1,246[1,234 to 1,259] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #336 / 420 | 1,162[1,155 to 1,169] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #338 / 419 | 1,198[1,191 to 1,206] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #339 / 371 | 1,198[1,186 to 1,210] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #339 / 399 | 1,224[1,216 to 1,232] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #340 / 385 | 1,190[1,181 to 1,198] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #342 / 416 | 1,260[1,252 to 1,267] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #342 / 414 | 1,210[1,201 to 1,219] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #342 / 421 | 1,244[1,238 to 1,251] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #343 / 395 | 1,204[1,193 to 1,215] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #344 / 404 | 1,188[1,180 to 1,196] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #345 / 419 | 1,239[1,231 to 1,246] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #345 / 402 | 1,193[1,184 to 1,201] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #346 / 419 | 1,174[1,166 to 1,182] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #346 / 419 | 1,229[1,221 to 1,237] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #346 / 421 | 1,178[1,173 to 1,183] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #347 / 419 | 1,177[1,169 to 1,185] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #348 / 421 | 1,089[1,083 to 1,096] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #348 / 421 | 1,222[1,216 to 1,229] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #348 / 421 | 1,211[1,207 to 1,215] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #349 / 421 | 1,237[1,232 to 1,242] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #349 / 420 | 1,182[1,175 to 1,189] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #349 / 421 | 1,191[1,185 to 1,196] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Llama 3.1 Instruct 8B across shared benchmark boards.
3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
100% win
Head-to-head3 shared boards
0% win
Head-to-head