Consensus score
12.6
95% interval 2.7 to 25.8
12.6
95% interval 2.7 to 25.8
25th
IQR spread 9.4 pct
57
Across 2 domains
2
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| LMArena Text (style control) LMArena · Japanese · Default | #239 / 288 | 1,196[1,178 to 1,214] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #240 / 288 | 1,145[1,127 to 1,162] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #250 / 289 | 1,203[1,181 to 1,224] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #253 / 289 | 1,137[1,116 to 1,158] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #260 / 301 | 1,190[1,164 to 1,216] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #260 / 301 | 1,260[1,233 to 1,286] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #262 / 304 | 1,200[1,174 to 1,226] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #262 / 304 | 1,266[1,240 to 1,292] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #263 / 320 | 1,246[1,229 to 1,262] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #267 / 320 | 1,186[1,170 to 1,202] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #294 / 419 | 1,259[1,251 to 1,266] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #303 / 420 | 1,269[1,263 to 1,275] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #305 / 419 | 1,248[1,241 to 1,255] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #306 / 419 | 1,205[1,198 to 1,213] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #306 / 385 | 1,260[1,252 to 1,268] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #309 / 420 | 1,219[1,213 to 1,225] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #311 / 402 | 1,240[1,231 to 1,248] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #312 / 414 | 1,260[1,252 to 1,269] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #312 / 393 | 1,285[1,273 to 1,296] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #312 / 419 | 1,251[1,244 to 1,258] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #313 / 419 | 1,185[1,178 to 1,192] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #313 / 402 | 1,193[1,185 to 1,202] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #313 / 385 | 1,200[1,192 to 1,208] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #314 / 393 | 1,215[1,204 to 1,227] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #314 / 371 | 1,238[1,226 to 1,250] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #315 / 395 | 1,266[1,256 to 1,276] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #315 / 404 | 1,221[1,213 to 1,229] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #315 / 421 | 1,247[1,242 to 1,252] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #316 / 414 | 1,190[1,181 to 1,198] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #317 / 371 | 1,147[1,135 to 1,159] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #317 / 421 | 1,278[1,274 to 1,283] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #318 / 395 | 1,185[1,175 to 1,195] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #318 / 391 | 1,165[1,153 to 1,178] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #318 / 404 | 1,183[1,176 to 1,191] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #318 / 419 | 1,193[1,186 to 1,201] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #318 / 391 | 1,259[1,246 to 1,272] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #318 / 421 | 1,267[1,263 to 1,271] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #319 / 421 | 1,188[1,183 to 1,193] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #319 / 421 | 1,173[1,167 to 1,179] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #319 / 419 | 1,280[1,272 to 1,287] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #319 / 421 | 1,245[1,240 to 1,251] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #320 / 399 | 1,266[1,258 to 1,274] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #321 / 421 | 1,090[1,084 to 1,096] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #321 / 421 | 1,207[1,204 to 1,211] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #322 / 338 | 27.5%[22.9% to 32%] | Unknown | Standard | 27 Jan 2025 |
| LMArena Text LMArena · Longer query · Default | #322 / 399 | 1,196[1,189 to 1,204] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #322 / 421 | 1,280[1,274 to 1,286] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #323 / 419 | 1,204[1,196 to 1,211] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #324 / 421 | 1,220[1,215 to 1,225] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #324 / 421 | 1,197[1,190 to 1,203] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #326 / 421 | 1,178[1,173 to 1,183] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #327 / 421 | 1,257[1,251 to 1,263] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #329 / 419 | 1,262[1,255 to 1,269] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #330 / 421 | 1,171[1,165 to 1,177] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #333 / 416 | 1,173[1,166 to 1,181] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #334 / 419 | 1,178[1,170 to 1,185] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #336 / 416 | 1,270[1,262 to 1,277] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Gemma 2 9B IT across shared benchmark boards.
3 shared boards
67% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
100% win
Head-to-head3 shared boards
0% win
Head-to-head