Consensus score
17.1
95% interval 9.8 to 27.4
17.1
95% interval 9.8 to 27.4
29th
IQR spread 7.9 pct
59
Across 2 domains
2
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| LMArena Text (style control) LMArena · Polish · Default | #186 / 243 | 1,351[1,274 to 1,428] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #215 / 243 | 1,277[1,204 to 1,350] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #223 / 288 | 1,229[1,213 to 1,246] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #227 / 288 | 1,176[1,160 to 1,192] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #233 / 289 | 1,238[1,219 to 1,257] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #236 / 289 | 1,174[1,155 to 1,193] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #239 / 301 | 1,313[1,289 to 1,336] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #246 / 301 | 1,247[1,224 to 1,271] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #248 / 320 | 1,270[1,255 to 1,284] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #249 / 304 | 1,293[1,270 to 1,316] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #253 / 419 | 1,293[1,286 to 1,300] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #256 / 304 | 1,228[1,205 to 1,251] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #257 / 320 | 1,209[1,194 to 1,223] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #269 / 420 | 1,298[1,292 to 1,303] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #275 / 419 | 1,273[1,267 to 1,279] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #278 / 385 | 1,292[1,284 to 1,299] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #283 / 419 | 1,240[1,234 to 1,247] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #283 / 395 | 1,301[1,292 to 1,310] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #290 / 393 | 1,311[1,301 to 1,322] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #290 / 399 | 1,301[1,294 to 1,308] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #291 / 421 | 1,275[1,270 to 1,279] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #292 / 420 | 1,249[1,243 to 1,254] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #292 / 391 | 1,291[1,279 to 1,302] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #292 / 419 | 1,280[1,273 to 1,286] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #295 / 385 | 1,234[1,227 to 1,241] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #296 / 421 | 1,290[1,286 to 1,293] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #297 / 402 | 1,266[1,259 to 1,273] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #298 / 395 | 1,221[1,212 to 1,230] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #299 / 419 | 1,304[1,297 to 1,311] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #300 / 338 | 36.5%[31.8% to 41.2%] | Unknown | Standard | 27 Jan 2025 |
| LMArena Text (style control) LMArena · Instruction following · Default | #300 / 421 | 1,272[1,267 to 1,276] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #300 / 404 | 1,248[1,241 to 1,255] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #301 / 393 | 1,241[1,231 to 1,252] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #301 / 402 | 1,222[1,214 to 1,229] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #301 / 421 | 1,217[1,213 to 1,221] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #302 / 419 | 1,212[1,206 to 1,219] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #302 / 421 | 1,211[1,206 to 1,216] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #302 / 371 | 1,261[1,250 to 1,271] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #303 / 399 | 1,230[1,223 to 1,237] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #303 / 414 | 1,278[1,270 to 1,285] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #303 / 421 | 1,309[1,304 to 1,315] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #304 / 419 | 1,224[1,217 to 1,230] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #305 / 421 | 1,129[1,123 to 1,134] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #305 / 371 | 1,171[1,161 to 1,182] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #305 / 404 | 1,212[1,205 to 1,219] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #305 / 421 | 1,231[1,228 to 1,235] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #305 / 421 | 1,299[1,295 to 1,304] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #306 / 391 | 1,198[1,186 to 1,209] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #306 / 421 | 1,206[1,201 to 1,211] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #308 / 421 | 1,282[1,277 to 1,288] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #309 / 414 | 1,207[1,200 to 1,215] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #309 / 421 | 1,228[1,222 to 1,233] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #309 / 419 | 1,289[1,282 to 1,295] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #311 / 419 | 1,228[1,222 to 1,235] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #312 / 421 | 1,242[1,238 to 1,246] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #314 / 416 | 1,211[1,204 to 1,217] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #314 / 416 | 1,304[1,297 to 1,310] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #315 / 419 | 1,206[1,199 to 1,212] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts · Default | #316 / 421 | 1,198[1,193 to 1,203] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Gemma 2 27B IT across shared benchmark boards.
3 shared boards
100% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
67% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
0% win
Head-to-head3 shared boards
100% win
Head-to-head3 shared boards
0% win
Head-to-head