Consensus score
30.9
95% interval 23.7 to 33.9
30.9
95% interval 23.7 to 33.9
34th
IQR spread 12.1 pct
74
Across 6 domains
3
Newest observation 6d ago
Median within-board percentile by capability domain across boards with sufficient peer overlap.
Best verified run per board, with confidence intervals and Pareto frontier status.
| Benchmark | Rank | Score | Cost | Status | Observed |
|---|---|---|---|---|---|
| METR time horizon METR time horizons · metr_agents/react | #16 / 23Tied #1 | 20.5 min[10.1 min to 40.8 min] | Unknown | Standard | Not stated |
| HLE Epoch AI Benchmarking Hub · Default | #54 / 56 | 4.1%[2.6% to 5.6%] | Unknown | Standard | Not stated |
| FrontierMath-2025-02-28-Private Epoch AI Benchmarking Hub · Default | #84 / 101 | 2.1%[0.4% to 3.7%] | Unknown | Standard | 6 Mar 2025 |
| LMArena Vision (style control) LMArena · Chinese · Default | #105 / 135 | 1,165[1,126 to 1,203] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · OCR · Default | #105 / 123 | 1,181[1,162 to 1,200] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Diagram · Default | #106 / 123 | 1,186[1,154 to 1,219] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Homework · Default | #107 / 118 | 1,172[1,133 to 1,211] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Chinese · Default | #111 / 135 | 1,118[1,080 to 1,157] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · Overall · Default | #111 / 167 | 1,161[1,153 to 1,169] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Diagram · Default | #117 / 123 | 1,134[1,102 to 1,166] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Homework · Default | #117 / 118 | 1,137[1,098 to 1,176] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · OCR · Default | #118 / 123 | 1,139[1,120 to 1,159] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision (style control) LMArena · English · Default | #120 / 167 | 1,154[1,143 to 1,164] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · Overall · Default | #126 / 167 | 1,125[1,118 to 1,133] | Unknown | Standard | 9 Nov 2026 |
| LMArena Vision LMArena · English · Default | #128 / 167 | 1,124[1,113 to 1,134] | Unknown | Standard | 9 Nov 2026 |
| LMArena Text (style control) LMArena · Polish · Default | #153 / 243 | 1,385[1,371 to 1,399] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · German · Default | #159 / 320 | 1,381[1,367 to 1,395] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Creative writing · Default | #160 / 419 | 1,371[1,365 to 1,377] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry entertainment and sports and media · Default | #166 / 419 | 1,365[1,360 to 1,371] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry writing and literature and language · Default | #169 / 420 | 1,378[1,373 to 1,383] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Japanese · Default | #170 / 288 | 1,310[1,296 to 1,325] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Coding · Default | #178 / 416 | 1,436[1,430 to 1,441] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · French · Default | #179 / 301 | 1,392[1,371 to 1,413] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Longer query · Default | #181 / 399 | 1,397[1,391 to 1,402] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Russian · Default | #182 / 385 | 1,376[1,369 to 1,383] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Korean · Default | #185 / 289 | 1,305[1,286 to 1,323] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Multi turn · Default | #185 / 419 | 1,390[1,384 to 1,396] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Instruction following · Default | #189 / 421 | 1,374[1,369 to 1,378] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Spanish · Default | #190 / 304 | 1,369[1,349 to 1,388] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts · Default | #195 / 421 | 1,399[1,395 to 1,403] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Hard prompts English · Default | #196 / 419 | 1,404[1,399 to 1,409] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Non English · Default | #197 / 421 | 1,359[1,355 to 1,363] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Japanese · Default | #199 / 288 | 1,234[1,220 to 1,248] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Exclude ties · Default | #199 / 421 | 1,346[1,342 to 1,350] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Overall · Default | #199 / 421 | 1,374[1,371 to 1,378] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry legal and government · Default | #200 / 393 | 1,383[1,374 to 1,392] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry software and IT services · Default | #201 / 421 | 1,408[1,403 to 1,412] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · German · Default | #206 / 320 | 1,297[1,284 to 1,311] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · English · Default | #206 / 421 | 1,383[1,379 to 1,387] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry medicine and healthcare · Default | #207 / 391 | 1,384[1,374 to 1,394] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Expert · Default | #208 / 371 | 1,373[1,363 to 1,382] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Polish · Default | #210 / 243 | 1,288[1,274 to 1,301] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · French · Default | #213 / 301 | 1,304[1,283 to 1,326] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry life and physical and social science · Default | #213 / 419 | 1,376[1,370 to 1,382] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry business and management and financial operations · Default | #215 / 414 | 1,354[1,348 to 1,360] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Industry mathematical · Default | #216 / 402 | 1,361[1,354 to 1,368] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Math · Default | #217 / 404 | 1,352[1,346 to 1,359] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry writing and literature and language · Default | #221 / 420 | 1,314[1,309 to 1,319] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text (style control) LMArena · Chinese · Default | #223 / 395 | 1,369[1,361 to 1,378] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Korean · Default | #226 / 289 | 1,198[1,179 to 1,216] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Spanish · Default | #226 / 304 | 1,286[1,266 to 1,305] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Multi turn · Default | #229 / 419 | 1,326[1,320 to 1,331] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Creative writing · Default | #230 / 419 | 1,292[1,286 to 1,298] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Russian · Default | #232 / 385 | 1,305[1,299 to 1,312] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Coding · Default | #235 / 416 | 1,342[1,337 to 1,348] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Math · Default | #236 / 404 | 1,307[1,300 to 1,313] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry mathematical · Default | #239 / 402 | 1,307[1,300 to 1,314] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry entertainment and sports and media · Default | #240 / 419 | 1,279[1,273 to 1,285] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Instruction following · Default | #243 / 421 | 1,297[1,293 to 1,301] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Longer query · Default | #243 / 399 | 1,311[1,305 to 1,317] | Unknown | Standard | 11 Nov 2026 |
| GPQA diamond Epoch AI Benchmarking Hub · Default | #244 / 338 | 55.3%[49.8% to 60.8%] | Unknown | Standard | 27 Jan 2025 |
| LMArena Text LMArena · Hard prompts · Default | #247 / 421 | 1,305[1,301 to 1,309] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Non English · Default | #248 / 421 | 1,283[1,279 to 1,287] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry software and IT services · Default | #250 / 421 | 1,316[1,311 to 1,320] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Expert · Default | #251 / 371 | 1,264[1,255 to 1,273] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Hard prompts English · Default | #253 / 419 | 1,311[1,306 to 1,317] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Overall · Default | #256 / 421 | 1,298[1,295 to 1,301] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Exclude ties · Default | #257 / 421 | 1,236[1,232 to 1,240] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Chinese · Default | #263 / 395 | 1,272[1,264 to 1,280] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · English · Default | #263 / 421 | 1,307[1,303 to 1,311] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry business and management and financial operations · Default | #272 / 414 | 1,255[1,248 to 1,261] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry legal and government · Default | #276 / 393 | 1,277[1,268 to 1,286] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry medicine and healthcare · Default | #277 / 391 | 1,257[1,247 to 1,266] | Unknown | Standard | 11 Nov 2026 |
| LMArena Text LMArena · Industry life and physical and social science · Default | #284 / 419 | 1,270[1,264 to 1,276] | Unknown | Standard | 11 Nov 2026 |
Direct pairwise win rates for Claude 3.5 Sonnet (Oct '24) across shared benchmark boards.
8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head8 shared boards
0% win
Head-to-head