Acropolis

ARC-AGI-2

ARC-AGI-2 results that Epoch AI republishes from the original runner.

Upstream source
General textScience
Independent. Run by an operator independent of the model vendors.Epoch AI Benchmarking Hub by Epoch AIVersion 1Data as of 17 Nov 2026

No filters. Showing 299 of 299 rows.

  1. 1
    OpenAIDossier

    max

    Score

    GPT-6 Astra, Score: 95% (scale 0.0 to 100.0)95%
    Cost per task
    Not tested
  2. 2
    GoogleDossier

    medium

    Score

    Gemini 4 Carbon, Score: 94.2% (scale 0.0 to 100.0)94.2%
    Cost per task
    Not tested
  3. 2
    OpenAIDossier

    max

    Score

    GPT-6.1 Sol, Score: 94.2% (scale 0.0 to 100.0)94.2%
    Cost per task
    Not tested
  4. 4
    AnthropicDossier

    xhigh

    Score

    Fable 5.2, Score: 93.8% (scale 0.0 to 100.0)93.8%
    Cost per task
    Not tested
  5. 5
    OpenAIDossier

    xhigh

    Score

    GPT-6 Astra, Score: 93.3% (scale 0.0 to 100.0)93.3%
    Cost per task
    Not tested
  6. 5
    AnthropicDossier

    high

    Score

    Opus 5.5, Score: 93.3% (scale 0.0 to 100.0)93.3%
    Cost per task
    Not tested
  7. 7
    AnthropicDossier

    max

    Score

    Fable 5.2, Score: 92.5% (scale 0.0 to 100.0)92.5%
    Cost per task
    Not tested
  8. 7
    OpenAIDossier

    max

    Score

    GPT-5.6 Sol, Score: 92.5% (scale 0.0 to 100.0)92.5%
    Cost per task
    $1.44
  9. 7
    AnthropicDossier

    xhigh

    Score

    Opus 5.5, Score: 92.5% (scale 0.0 to 100.0)92.5%
    Cost per task
    Not tested
  10. 10
    GoogleDossier

    high

    Score

    Gemini 4 Carbon, Score: 92.1% (scale 0.0 to 100.0)92.1%
    Cost per task
    Not tested
  11. 10
    OpenAIDossier

    high

    Score

    GPT-6 Astra, Score: 92.1% (scale 0.0 to 100.0)92.1%
    Cost per task
    Not tested
  12. 10
    OpenAIDossier

    medium

    Score

    GPT-6 Astra, Score: 92.1% (scale 0.0 to 100.0)92.1%
    Cost per task
    Not tested
  13. 13
    OpenAIDossier

    xhigh

    Score

    GPT-6.1 Sol, Score: 91.7% (scale 0.0 to 100.0)91.7%
    Cost per task
    Not tested
  14. 13
    OpenAIDossier

    high

    Score

    GPT-6.1 Sol, Score: 91.7% (scale 0.0 to 100.0)91.7%
    Cost per task
    Not tested
  15. 13
    AnthropicDossier

    max

    Score

    Opus 5.5, Score: 91.7% (scale 0.0 to 100.0)91.7%
    Cost per task
    Not tested
  16. 16
    GoogleDossier

    high

    Score

    Gemini 4 Argon, Score: 91.3% (scale 0.0 to 100.0)91.3%
    Cost per task
    Not tested
  17. 17
    AnthropicDossier

    max

    Score

    Opus 5, Score: 90.4% (scale 0.0 to 100.0)90.4%
    Cost per task
    Not tested
  18. 18
    AnthropicDossier

    high

    Score

    Fable 5.2, Score: 90.4% (scale 0.0 to 100.0)90.4%
    Cost per task
    Not tested
  19. 19
    AnthropicDossier

    max

    Score

    Fable 5.1, Score: 90% (scale 0.0 to 100.0)90%
    Cost per task
    Not tested
  20. 19
    AnthropicDossier

    xhigh

    Score

    Fable 5.1, Score: 90% (scale 0.0 to 100.0)90%
    Cost per task
    Not tested
  21. 19
    OpenAIDossier

    xhigh

    Score

    GPT-5.6 Sol, Score: 90% (scale 0.0 to 100.0)90%
    Cost per task
    $1.04
  22. 19
    OpenAIDossier

    xhigh

    Score

    GPT-5.6 Sol, Score: 90% (scale 0.0 to 100.0)90%
    Cost per task
    Not tested
  23. 23
    AnthropicDossier

    medium

    Score

    Fable 5.2, Score: 89.6% (scale 0.0 to 100.0)89.6%
    Cost per task
    Not tested
  24. 23
    OpenAIDossier

    max

    Score

    GPT-6 Sol, Score: 89.6% (scale 0.0 to 100.0)89.6%
    Cost per task
    Not tested
  25. 25
    AnthropicDossier

    max

    Score

    Fable 5, Score: 89.2% (scale 0.0 to 100.0)89.2%
    Cost per task
    Not tested
  26. 25
    GoogleDossier

    high

    Score

    Gemini 3.8 Flash, Score: 89.2% (scale 0.0 to 100.0)89.2%
    Cost per task
    Not tested
  27. 27
    AnthropicDossier

    high

    Score

    Fable 5.1, Score: 88.8% (scale 0.0 to 100.0)88.8%
    Cost per task
    Not tested
  28. 28
    AnthropicDossier

    xhigh

    Score

    Fable 5, Score: 88.3% (scale 0.0 to 100.0)88.3%
    Cost per task
    Not tested
  29. 29
    AnthropicDossier

    max

    Score

    Opus 5, Score: 88.3% (scale 0.0 to 100.0)88.3%
    Cost per task
    Not tested
  30. 29
    AnthropicDossier

    high

    Score

    Opus 5, Score: 88.3% (scale 0.0 to 100.0)88.3%
    Cost per task
    Not tested
  31. 31
    AnthropicDossier

    high

    Score

    Fable 5, Score: 87.5% (scale 0.0 to 100.0)87.5%
    Cost per task
    Not tested
  32. 31
    AnthropicDossier

    medium

    Score

    Opus 5.5, Score: 87.5% (scale 0.0 to 100.0)87.5%
    Cost per task
    Not tested
  33. 33
    GoogleDossier

    medium

    Score

    Gemini 4 Argon, Score: 87.1% (scale 0.0 to 100.0)87.1%
    Cost per task
    Not tested
  34. 34
    AnthropicDossier

    low

    Score

    Fable 5.2, Score: 86.7% (scale 0.0 to 100.0)86.7%
    Cost per task
    Not tested
  35. 34
    OpenAIDossier

    medium

    Score

    GPT-6.1 Sol, Score: 86.7% (scale 0.0 to 100.0)86.7%
    Cost per task
    Not tested
  36. 36
    AnthropicDossier

    medium

    Score

    Fable 5.1, Score: 86.3% (scale 0.0 to 100.0)86.3%
    Cost per task
    Not tested
  37. 37
    OpenAIDossier

    high

    Score

    GPT-5.6 Sol, Score: 85.4% (scale 0.0 to 100.0)85.4%
    Cost per task
    $0.74
  38. 38
    OpenAIDossier

    low

    Score

    GPT-6 Astra, Score: 85.4% (scale 0.0 to 100.0)85.4%
    Cost per task
    Not tested
  39. 39
    OpenAIDossier

    xhigh

    Score

    GPT-5.5, Score: 85% (scale 0.0 to 100.0)85%
    Cost per task
    $1.87
  40. 39
    OpenAIDossier

    xhigh

    Score

    GPT-5.5, Score: 85% (scale 0.0 to 100.0)85%
    Cost per task
    Not tested
  41. 41
    GoogleDossier

    high

    Score

    Gemini 3.7 Flash, Score: 84.6% (scale 0.0 to 100.0)84.6%
    Cost per task
    Not tested
  42. 42
    GoogleDossier

    Score

    Gemini 3 Deep Think Preview, Score: 84.6% (scale 0.0 to 100.0)84.6%
    Cost per task
    Not tested
  43. 42
    OpenAIDossier

    high

    Score

    GPT-5.5 Pro, Score: 84.6% (scale 0.0 to 100.0)84.6%
    Cost per task
    $10.51
  44. 44
    OpenAIDossier

    xhigh

    Score

    GPT-5.5 Pro, Score: 84.2% (scale 0.0 to 100.0)84.2%
    Cost per task
    $10.76
  45. 44
    OpenAIDossier

    xhigh

    Score

    GPT-5.5 Pro, Score: 84.2% (scale 0.0 to 100.0)84.2%
    Cost per task
    Not tested
  46. 46
    OpenAIDossier

    max

    Score

    GPT-5.6 Terra, Score: 83.9% (scale 0.0 to 100.0)83.9%
    Cost per task
    $1.09
  47. 47
    AnthropicDossier

    xhigh

    Score

    Sonnet 5.5, Score: 83.9% (scale 0.0 to 100.0)83.9%
    Cost per task
    Not tested
  48. 48
    OpenAIDossier

    xhigh

    Score

    GPT-5.4 Pro, Score: 83.3% (scale 0.0 to 100.0)83.3%
    Cost per task
    $16.41
  49. 48
    OpenAIDossier

    xhigh

    Score

    GPT-5.4 Pro, Score: 83.3% (scale 0.0 to 100.0)83.3%
    Cost per task
    Not tested
  50. 48
    OpenAIDossier

    high

    Score

    GPT-5.5, Score: 83.3% (scale 0.0 to 100.0)83.3%
    Cost per task
    $1.45
  51. 51
    GoogleDossier

    medium

    Score

    Gemini 3.8 Flash, Score: 82.9% (scale 0.0 to 100.0)82.9%
    Cost per task
    Not tested
  52. 52
    AnthropicDossier

    medium

    Score

    Fable 5, Score: 82.5% (scale 0.0 to 100.0)82.5%
    Cost per task
    Not tested
  53. 53
    Thinking MachinesDossier

    xhigh

    Score

    Inkling 2 Small, Score: 81.7% (scale 0.0 to 100.0)81.7%
    Cost per task
    Not tested
  54. 54
    AnthropicDossier

    low

    Score

    Fable 5.1, Score: 78.3% (scale 0.0 to 100.0)78.3%
    Cost per task
    Not tested
  55. 55
    DeepSeekDossier

    max

    Score

    DeepSeek V4.1 Flash 1017, Score: 78.1% (scale 0.0 to 100.0)78.1%
    Cost per task
    Not tested
  56. 55
    OpenAIDossier

    xhigh

    Score

    GPT-6 Sol, Score: 78.1% (scale 0.0 to 100.0)78.1%
    Cost per task
    Not tested
  57. 57
    GoogleDossier

    low

    Score

    Gemini 3.8 Flash, Score: 77.5% (scale 0.0 to 100.0)77.5%
    Cost per task
    Not tested
  58. 58
    GoogleDossier

    Score

    Gemini 3.1 Pro Preview, Score: 77.1% (scale 0.0 to 100.0)77.1%
    Cost per task
    $0.96
  59. 59
    GoogleDossier

    Score

    Gemini 3.1 Pro Preview, Score: 77.1% (scale 0.0 to 100.0)77.1%
    Cost per task
    $0.96
  60. 60
    AnthropicDossier

    low

    Score

    Fable 5, Score: 76.8% (scale 0.0 to 100.0)76.8%
    Cost per task
    Not tested
  61. 61
    OpenAIDossier

    low

    Score

    GPT-6.1 Sol, Score: 76.7% (scale 0.0 to 100.0)76.7%
    Cost per task
    Not tested
  62. 62
    AnthropicDossier

    max

    Score

    Opus 4.7, Score: 75.8% (scale 0.0 to 100.0)75.8%
    Cost per task
    Not tested
  63. 63
    AnthropicDossier

    max

    Score

    Opus 4.7, Score: 75.8% (scale 0.0 to 100.0)75.8%
    Cost per task
    $7.43
  64. 64
    OpenAIDossier

    xhigh

    Score

    GPT-5.6 Terra, Score: 74.2% (scale 0.0 to 100.0)74.2%
    Cost per task
    $0.69
  65. 64
    OpenAIDossier

    xhigh

    Score

    GPT-5.6 Terra, Score: 74.2% (scale 0.0 to 100.0)74.2%
    Cost per task
    Not tested
  66. 66
    OpenAIDossier

    xhigh

    Score

    GPT-5.4, Score: 74% (scale 0.0 to 100.0)74%
    Cost per task
    $1.52
  67. 66
    OpenAIDossier

    xhigh

    Score

    GPT-5.4, Score: 74% (scale 0.0 to 100.0)74%
    Cost per task
    Not tested
  68. 68
    DeepSeekDossier

    low

    Score

    DeepSeek V4.1 Flash 1017, Score: 73.6% (scale 0.0 to 100.0)73.6%
    Cost per task
    Not tested
  69. 69
    DeepSeekDossier

    max

    Score

    DeepSeek V4.1 Flash, Score: 72.9% (scale 0.0 to 100.0)72.9%
    Cost per task
    Not tested
  70. 70
    GoogleDossier

    high

    Score

    Gemini 3.5 Flash, Score: 72.1% (scale 0.0 to 100.0)72.1%
    Cost per task
    $0.85
  71. 70
    AnthropicDossier

    high

    Score

    Opus 4.8, Score: 72.1% (scale 0.0 to 100.0)72.1%
    Cost per task
    $2.74
  72. 72
    AnthropicDossier

    medium

    Score

    Opus 4.8, Score: 71.7% (scale 0.0 to 100.0)71.7%
    Cost per task
    $2.39
  73. 73
    OpenAIDossier

    medium

    Score

    GPT-5.5, Score: 70.4% (scale 0.0 to 100.0)70.4%
    Cost per task
    $0.86
  74. 74
    AnthropicDossier

    low

    Score

    Opus 5.5, Score: 70.1% (scale 0.0 to 100.0)70.1%
    Cost per task
    Not tested
  75. 75
    AnthropicDossier

    high · 120,000 budget

    Score

    Opus 4.6, Score: 69.2% (scale 0.0 to 100.0)69.2%
    Cost per task
    Not tested
  76. 76
    OpenAIDossier

    high

    Score

    GPT-6 Sol, Score: 68.9% (scale 0.0 to 100.0)68.9%
    Cost per task
    Not tested
  77. 77
    AnthropicDossier

    max · 120,000 budget

    Score

    Opus 4.6, Score: 68.8% (scale 0.0 to 100.0)68.8%
    Cost per task
    Not tested
  78. 78
    DeepSeekDossier

    high

    Score

    DeepSeek V4.1 Flash 1017, Score: 68.6% (scale 0.0 to 100.0)68.6%
    Cost per task
    Not tested
  79. 79
    AnthropicDossier

    high

    Score

    Opus 4.7, Score: 68.3% (scale 0.0 to 100.0)68.3%
    Cost per task
    Not tested
  80. 80
    AnthropicDossier

    high

    Score

    Opus 4.7, Score: 68.3% (scale 0.0 to 100.0)68.3%
    Cost per task
    $3.17
  81. 81
    DeepSeekDossier

    high

    Score

    DeepSeek V4.1 Flash, Score: 67.5% (scale 0.0 to 100.0)67.5%
    Cost per task
    Not tested
  82. 81
    OpenAIDossier

    high

    Score

    GPT-5.4, Score: 67.5% (scale 0.0 to 100.0)67.5%
    Cost per task
    $1.02
  83. 81
    AnthropicDossier

    medium

    Score

    Opus 4.7, Score: 67.5% (scale 0.0 to 100.0)67.5%
    Cost per task
    $2.96
  84. 84
    AnthropicDossier

    high

    Score

    Sonnet 5.5, Score: 67.4% (scale 0.0 to 100.0)67.4%
    Cost per task
    Not tested
  85. 85

    xhigh

    Score

    Grok 4.6, Score: 67.1% (scale 0.0 to 100.0)67.1%
    Cost per task
    Not tested
  86. 86
    OpenAIDossier

    medium

    Score

    GPT-5.6 Sol, Score: 67.1% (scale 0.0 to 100.0)67.1%
    Cost per task
    $0.47
  87. 86
    OpenAIDossier

    high

    Score

    GPT-5.6 Terra, Score: 67.1% (scale 0.0 to 100.0)67.1%
    Cost per task
    $0.55
  88. 88
    AnthropicDossier

    medium · 120,000 budget

    Score

    Opus 4.6, Score: 66.3% (scale 0.0 to 100.0)66.3%
    Cost per task
    Not tested
  89. 89

    max

    Score

    GLM-5.3 Flash, Score: 65.8% (scale 0.0 to 100.0)65.8%
    Cost per task
    Not tested
  90. 90

    Score

    Grok 4.20, Score: 65.1% (scale 0.0 to 100.0)65.1%
    Cost per task
    $0.92
  91. 91

    high

    Score

    Grok 4.6, Score: 65.1% (scale 0.0 to 100.0)65.1%
    Cost per task
    Not tested
  92. 92
    AnthropicDossier

    low · 120,000 budget

    Score

    Opus 4.6, Score: 64.6% (scale 0.0 to 100.0)64.6%
    Cost per task
    Not tested
  93. 93
    GoogleDossier

    medium

    Score

    Gemini 3.7 Flash, Score: 63.8% (scale 0.0 to 100.0)63.8%
    Cost per task
    Not tested
  94. 94
    AnthropicDossier

    low

    Score

    Opus 4.8, Score: 62.2% (scale 0.0 to 100.0)62.2%
    Cost per task
    $1.68
  95. 95
    AnthropicDossier

    low

    Score

    Opus 4.7, Score: 62.1% (scale 0.0 to 100.0)62.1%
    Cost per task
    $2.38
  96. 96
    DeepSeekDossier

    max

    Score

    DeepSeek V4-Flash 0731, Score: 61.4% (scale 0.0 to 100.0)61.4%
    Cost per task
    Not tested
  97. 96

    xhigh

    Score

    Grok 4.7, Score: 61.4% (scale 0.0 to 100.0)61.4%
    Cost per task
    Not tested
  98. 98
    DeepSeekDossier

    max

    Score

    DeepSeek V4 Pro 0813, Score: 61.3% (scale 0.0 to 100.0)61.3%
    Cost per task
    Not tested
  99. 98

    medium

    Score

    Grok 4.6, Score: 61.3% (scale 0.0 to 100.0)61.3%
    Cost per task
    Not tested
  100. 98
    AnthropicDossier

    xhigh

    Score

    Haiku 5.5, Score: 61.3% (scale 0.0 to 100.0)61.3%
    Cost per task
    Not tested
  101. 101
    DeepSeekDossier

    low

    Score

    DeepSeek V4.1 Flash, Score: 60.6% (scale 0.0 to 100.0)60.6%
    Cost per task
    Not tested
  102. 102
    AnthropicDossier

    high

    Score

    Sonnet 4.6, Score: 60.4% (scale 0.0 to 100.0)60.4%
    Cost per task
    $2.70
  103. 103
    GoogleDossier

    high

    Score

    Gemini 3.6 Flash, Score: 60.4% (scale 0.0 to 100.0)60.4%
    Cost per task
    Not tested
  104. 103
    Moonshot AIDossier

    max

    Score

    Kimi K3, Score: 60.4% (scale 0.0 to 100.0)60.4%
    Cost per task
    $1.59
  105. 105
    DeepSeekDossier

    high

    Score

    DeepSeek V4 Pro 0813, Score: 59.7% (scale 0.0 to 100.0)59.7%
    Cost per task
    Not tested
  106. 106
    OpenAIDossier

    none

    Score

    GPT-6 Astra, Score: 59.6% (scale 0.0 to 100.0)59.6%
    Cost per task
    Not tested
  107. 107
    OpenAIDossier

    max

    Score

    GPT-5.6 Luna, Score: 59.5% (scale 0.0 to 100.0)59.5%
    Cost per task
    $0.67
  108. 108
    OpenAIDossier

    max

    Score

    GPT-6 Luna, Score: 59.3% (scale 0.0 to 100.0)59.3%
    Cost per task
    Not tested
  109. 109

    medium

    Score

    Grok 4.7, Score: 58.8% (scale 0.0 to 100.0)58.8%
    Cost per task
    Not tested
  110. 110

    high

    Score

    Grok 4.7, Score: 58.3% (scale 0.0 to 100.0)58.3%
    Cost per task
    Not tested
  111. 111
    AnthropicDossier

    max

    Score

    Sonnet 4.6, Score: 58.3% (scale 0.0 to 100.0)58.3%
    Cost per task
    $2.72
  112. 112
    OpenAIDossier

    medium

    Score

    GPT-6 Sol, Score: 57.8% (scale 0.0 to 100.0)57.8%
    Cost per task
    Not tested
  113. 113

    xhigh

    Score

    Muse Spark Open, Score: 57.5% (scale 0.0 to 100.0)57.5%
    Cost per task
    Not tested
  114. 114
    DeepSeekDossier

    low

    Score

    DeepSeek V4 Pro 0813, Score: 56.3% (scale 0.0 to 100.0)56.3%
    Cost per task
    Not tested
  115. 115
    DeepSeekDossier

    high

    Score

    DeepSeek V4-Flash 0731, Score: 56% (scale 0.0 to 100.0)56%
    Cost per task
    Not tested
  116. 116
    OpenAIDossier

    medium

    Score

    GPT-5.4, Score: 55.4% (scale 0.0 to 100.0)55.4%
    Cost per task
    $0.68
  117. 117
    Moonshot AIDossier

    high

    Score

    Kimi K3, Score: 55% (scale 0.0 to 100.0)55%
    Cost per task
    $0.95
  118. 118
    OpenAIDossier

    high

    Score

    GPT-5.2 Pro, Score: 54.2% (scale 0.0 to 100.0)54.2%
    Cost per task
    $15.72
  119. 119
    GoogleDossier

    low

    Score

    Gemini 3.7 Flash, Score: 52.9% (scale 0.0 to 100.0)52.9%
    Cost per task
    Not tested
  120. 120
    OpenAIDossier

    xhigh

    Score

    GPT-5.2, Score: 52.9% (scale 0.0 to 100.0)52.9%
    Cost per task
    $1.90
  121. 120
    OpenAIDossier

    xhigh

    Score

    GPT-5.2, Score: 52.9% (scale 0.0 to 100.0)52.9%
    Cost per task
    Not tested
  122. 120
    OpenAIDossier

    xhigh

    Score

    GPT-5.2, Score: 52.9% (scale 0.0 to 100.0)52.9%
    Cost per task
    Not tested
  123. 123

    high

    Score

    Grok 4.5, Score: 52.6% (scale 0.0 to 100.0)52.6%
    Cost per task
    $0.78
  124. 123

    medium

    Score

    Grok 4.5, Score: 52.6% (scale 0.0 to 100.0)52.6%
    Cost per task
    $0.75
  125. 125
    GoogleDossier

    medium

    Score

    Gemini 3.6 Flash, Score: 50.4% (scale 0.0 to 100.0)50.4%
    Cost per task
    Not tested
  126. 126

    high

    Score

    GLM-5.3 Flash, Score: 50.1% (scale 0.0 to 100.0)50.1%
    Cost per task
    Not tested
  127. 127
    GoogleDossier

    low

    Score

    Gemini 4 Carbon, Score: 49.6% (scale 0.0 to 100.0)49.6%
    Cost per task
    Not tested
  128. 128
    OpenAIDossier

    xhigh

    Score

    GPT-5.6 Luna, Score: 47.6% (scale 0.0 to 100.0)47.6%
    Cost per task
    $0.54
  129. 128
    OpenAIDossier

    xhigh

    Score

    GPT-5.6 Luna, Score: 47.6% (scale 0.0 to 100.0)47.6%
    Cost per task
    Not tested
  130. 130

    high

    Score

    Muse Spark Open, Score: 47.5% (scale 0.0 to 100.0)47.5%
    Cost per task
    Not tested
  131. 131
    DeepSeekDossier

    low

    Score

    DeepSeek V4-Flash 0731, Score: 46% (scale 0.0 to 100.0)46%
    Cost per task
    Not tested
  132. 132
    GoogleDossier

    Score

    Gemini 3 Deep Think Preview, Score: 45.1% (scale 0.0 to 100.0)45.1%
    Cost per task
    Not tested
  133. 133
    OpenAIDossier

    high

    Score

    GPT-5.2, Score: 43.3% (scale 0.0 to 100.0)43.3%
    Cost per task
    $1.39
  134. 134
    OpenAIDossier

    low

    Score

    GPT-5.6 Sol, Score: 42.5% (scale 0.0 to 100.0)42.5%
    Cost per task
    $0.32
  135. 135
    AlibabaDossier

    xhigh

    Score

    Qwen3.8-27B, Score: 42.4% (scale 0.0 to 100.0)42.4%
    Cost per task
    Not tested
  136. 136
    GoogleDossier

    low

    Score

    Gemini 4 Argon, Score: 42.1% (scale 0.0 to 100.0)42.1%
    Cost per task
    Not tested
  137. 137
    OpenAIDossier

    xhigh

    Score

    GPT-6 Luna, Score: 41.9% (scale 0.0 to 100.0)41.9%
    Cost per task
    Not tested
  138. 138
    Thinking MachinesDossier

    xhigh

    Score

    Inkling Small, Score: 40.1% (scale 0.0 to 100.0)40.1%
    Cost per task
    Not tested
  139. 139
    OpenAIDossier

    medium

    Score

    GPT-5.2 Pro, Score: 38.5% (scale 0.0 to 100.0)38.5%
    Cost per task
    $8.99
  140. 140
    AnthropicDossier

    thinking · 64,000 budget

    Score

    Opus 4.5, Score: 37.6% (scale 0.0 to 100.0)37.6%
    Cost per task
    $2.40
  141. 141
    OpenAIDossier

    medium

    Score

    GPT-5.6 Terra, Score: 37.5% (scale 0.0 to 100.0)37.5%
    Cost per task
    $0.27
  142. 142
    Thinking MachinesDossier

    Score

    Inkling, Score: 36.5% (scale 0.0 to 100.0)36.5%
    Cost per task
    $0.64
  143. 143
    GoogleDossier

    high

    Score

    Gemini 3 Flash Preview, Score: 33.6% (scale 0.0 to 100.0)33.6%
    Cost per task
    Not tested
  144. 144
    OpenAIDossier

    low

    Score

    GPT-5.5, Score: 33.3% (scale 0.0 to 100.0)33.3%
    Cost per task
    $0.35
  145. 145

    low

    Score

    Grok 4.5, Score: 33.1% (scale 0.0 to 100.0)33.1%
    Cost per task
    $0.40
  146. 146
    Thinking MachinesDossier

    high

    Score

    Inkling Small, Score: 33.1% (scale 0.0 to 100.0)33.1%
    Cost per task
    Not tested
  147. 147
    AnthropicDossier

    medium

    Score

    Sonnet 5.5, Score: 32.8% (scale 0.0 to 100.0)32.8%
    Cost per task
    Not tested
  148. 148
    OpenAIDossier

    low

    Score

    GPT-6 Sol, Score: 31.5% (scale 0.0 to 100.0)31.5%
    Cost per task
    Not tested
  149. 149
    OpenAIDossier

    high

    Score

    GPT-6 Luna, Score: 31.4% (scale 0.0 to 100.0)31.4%
    Cost per task
    Not tested
  150. 150
    GoogleDossier

    Score

    Gemini 3 Pro Preview, Score: 31.1% (scale 0.0 to 100.0)31.1%
    Cost per task
    Not tested
  151. 151
    AnthropicDossier

    high

    Score

    Haiku 5.5, Score: 30.7% (scale 0.0 to 100.0)30.7%
    Cost per task
    Not tested
  152. 152
    GoogleDossier

    low

    Score

    Gemini 3.6 Flash, Score: 30.4% (scale 0.0 to 100.0)30.4%
    Cost per task
    Not tested
  153. 153
    OpenAIDossier

    high

    Score

    GPT-5.6 Luna, Score: 29.3% (scale 0.0 to 100.0)29.3%
    Cost per task
    $0.29
  154. 154
    OpenAIDossier

    low

    Score

    GPT-5.4, Score: 29.2% (scale 0.0 to 100.0)29.2%
    Cost per task
    $0.27
  155. 155

    low

    Score

    GLM-5.3 Flash, Score: 27.9% (scale 0.0 to 100.0)27.9%
    Cost per task
    Not tested
  156. 156

    low

    Score

    Grok 4.6, Score: 27.6% (scale 0.0 to 100.0)27.6%
    Cost per task
    Not tested
  157. 157

    medium

    Score

    Muse Spark Open, Score: 27.5% (scale 0.0 to 100.0)27.5%
    Cost per task
    Not tested
  158. 158
    OpenAIDossier

    medium

    Score

    GPT-5.2, Score: 26.7% (scale 0.0 to 100.0)26.7%
    Cost per task
    $0.76
  159. 159
    AnthropicDossier

    low

    Score

    Sonnet 5.5, Score: 24% (scale 0.0 to 100.0)24%
    Cost per task
    Not tested
  160. 160
    ReflectionDossier

    xhigh

    Score

    Beam 1.0, Score: 23.5% (scale 0.0 to 100.0)23.5%
    Cost per task
    Not tested
  161. 161
    AnthropicDossier

    thinking · 16,000 budget

    Score

    Opus 4.5, Score: 22.8% (scale 0.0 to 100.0)22.8%
    Cost per task
    $0.79
  162. 162
    AlibabaDossier

    low

    Score

    Qwen3.8-27B, Score: 22.8% (scale 0.0 to 100.0)22.8%
    Cost per task
    Not tested
  163. 163

    Score

    GLM-5.2, Score: 22.8% (scale 0.0 to 100.0)22.8%
    Cost per task
    $0.25
  164. 164
    ReflectionDossier

    high

    Score

    Beam 1.0, Score: 20% (scale 0.0 to 100.0)20%
    Cost per task
    Not tested
  165. 165
    OpenAIDossier

    xhigh

    Score

    GPT-5.4 mini, Score: 18.9% (scale 0.0 to 100.0)18.9%
    Cost per task
    $0.75
  166. 165
    OpenAIDossier

    xhigh

    Score

    GPT-5.4 mini, Score: 18.9% (scale 0.0 to 100.0)18.9%
    Cost per task
    Not tested
  167. 167
    OpenAIDossier

    low

    Score

    GPT-5.6 Terra, Score: 18.8% (scale 0.0 to 100.0)18.8%
    Cost per task
    $0.17
  168. 168
    OpenAIDossier

    Score

    GPT-5 Pro, Score: 18.3% (scale 0.0 to 100.0)18.3%
    Cost per task
    $7.14
  169. 169
    OpenAIDossier

    medium

    Score

    GPT-6 Luna, Score: 18.1% (scale 0.0 to 100.0)18.1%
    Cost per task
    Not tested
  170. 170
    OpenAIDossier

    high · thinking

    Score

    GPT-5.1, Score: 17.6% (scale 0.0 to 100.0)17.6%
    Cost per task
    $1.17
  171. 171

    low

    Score

    Grok 4.7, Score: 16.7% (scale 0.0 to 100.0)16.7%
    Cost per task
    Not tested
  172. 172

    thinking

    Score

    Grok 4 (0709), Score: 16% (scale 0.0 to 100.0)16%
    Cost per task
    Not tested
  173. 173
    AnthropicDossier

    thinking · 8,000 budget

    Score

    Opus 4.5, Score: 13.9% (scale 0.0 to 100.0)13.9%
    Cost per task
    $0.48
  174. 174
    Thinking MachinesDossier

    medium

    Score

    Inkling Small, Score: 13.6% (scale 0.0 to 100.0)13.6%
    Cost per task
    Not tested
  175. 175
    AnthropicDossier

    32,000 budget

    Score

    Sonnet 4.5, Score: 13.6% (scale 0.0 to 100.0)13.6%
    Cost per task
    $0.76
  176. 176
    AlibabaDossier

    medium

    Score

    Qwen3.8-27B, Score: 13.2% (scale 0.0 to 100.0)13.2%
    Cost per task
    Not tested
  177. 177
    OpenAIDossier

    high

    Score

    GPT-5.4 mini, Score: 13.2% (scale 0.0 to 100.0)13.2%
    Cost per task
    $0.56
  178. 178
    GoogleDossier

    medium

    Score

    Gemini 3 Flash Preview, Score: 12.8% (scale 0.0 to 100.0)12.8%
    Cost per task
    Not tested
  179. 179
    Moonshot AIDossier

    low

    Score

    Kimi K3, Score: 12.4% (scale 0.0 to 100.0)12.4%
    Cost per task
    $0.25
  180. 180

    low

    Score

    Muse Spark Open, Score: 12.2% (scale 0.0 to 100.0)12.2%
    Cost per task
    Not tested
  181. 181
    Moonshot AIDossier

    Score

    Kimi K2.5, Score: 11.8% (scale 0.0 to 100.0)11.8%
    Cost per task
    $0.28
  182. 182
    GoogleDossier

    high

    Score

    Gemini 3.5 Flash-Lite, Score: 10.3% (scale 0.0 to 100.0)10.3%
    Cost per task
    Not tested
  183. 183
    OpenAIDossier

    high

    Score

    GPT-5, Score: 9.9% (scale 0.0 to 100.0)9.9%
    Cost per task
    $0.73
  184. 184
    OpenAIDossier

    low

    Score

    GPT-5.2, Score: 9.7% (scale 0.0 to 100.0)9.7%
    Cost per task
    $0.26
  185. 185
    AnthropicDossier

    medium

    Score

    Haiku 5.5, Score: 9.4% (scale 0.0 to 100.0)9.4%
    Cost per task
    Not tested
  186. 186
    GoogleDossier

    minimal

    Score

    Gemini 3.5 Flash, Score: 8.9% (scale 0.0 to 100.0)8.9%
    Cost per task
    $0.11
  187. 187
    AnthropicDossier

    16,000 budget

    Score

    Opus 4, Score: 8.6% (scale 0.0 to 100.0)8.6%
    Cost per task
    $1.93
  188. 188
    AnthropicDossier

    none · thinking

    Score

    Opus 4.5, Score: 7.8% (scale 0.0 to 100.0)7.8%
    Cost per task
    $0.22
  189. 189
    OpenAIDossier

    medium

    Score

    GPT-5, Score: 7.5% (scale 0.0 to 100.0)7.5%
    Cost per task
    $0.45
  190. 190
    OpenAIDossier

    medium

    Score

    GPT-5.6 Luna, Score: 7.4% (scale 0.0 to 100.0)7.4%
    Cost per task
    $0.11
  191. 191
    AnthropicDossier

    16,000 budget

    Score

    Sonnet 4.5, Score: 6.9% (scale 0.0 to 100.0)6.9%
    Cost per task
    $0.35
  192. 191
    AnthropicDossier

    8,000 budget

    Score

    Sonnet 4.5, Score: 6.9% (scale 0.0 to 100.0)6.9%
    Cost per task
    $0.23
  193. 193
    OpenAIDossier

    medium · thinking

    Score

    GPT-5.1, Score: 6.5% (scale 0.0 to 100.0)6.5%
    Cost per task
    $0.42
  194. 193
    OpenAIDossier

    high

    Score

    o3, Score: 6.5% (scale 0.0 to 100.0)6.5%
    Cost per task
    $0.83
  195. 195
    ReflectionDossier

    medium

    Score

    Beam 1.0, Score: 6.4% (scale 0.0 to 100.0)6.4%
    Cost per task
    Not tested
  196. 196
    SamsungDossier

    Score

    Tiny Recursion Model, Score: 6.3% (scale 0.0 to 100.0)6.3%
    Cost per task
    $2.10
  197. 197
    OpenAIDossier

    high

    Score

    o4-mini, Score: 6.1% (scale 0.0 to 100.0)6.1%
    Cost per task
    $0.86
  198. 198
    AnthropicDossier

    16,000 budget

    Score

    Claude Sonnet 4, Score: 5.9% (scale 0.0 to 100.0)5.9%
    Cost per task
    $0.49
  199. 199
    AnthropicDossier

    1,000 budget

    Score

    Sonnet 4.5, Score: 5.8% (scale 0.0 to 100.0)5.8%
    Cost per task
    $0.14
  200. 200
    OpenAIDossier

    xhigh

    Score

    GPT-5.4 nano, Score: 5.7% (scale 0.0 to 100.0)5.7%
    Cost per task
    $0.16
  201. 200
    OpenAIDossier

    xhigh

    Score

    GPT-5.4 nano, Score: 5.7% (scale 0.0 to 100.0)5.7%
    Cost per task
    Not tested
  202. 202

    Score

    Grok 4 Fast, Score: 5.3% (scale 0.0 to 100.0)5.3%
    Cost per task
    $0.061
  203. 203
    GoogleDossier

    medium

    Score

    Gemini 3.5 Flash-Lite, Score: 5.3% (scale 0.0 to 100.0)5.3%
    Cost per task
    Not tested
  204. 204
    OpenAIDossier

    low

    Score

    GPT-5.6 Luna, Score: 5.1% (scale 0.0 to 100.0)5.1%
    Cost per task
    $0.070
  205. 205
    Thinking MachinesDossier

    low

    Score

    Inkling Small, Score: 4.9% (scale 0.0 to 100.0)4.9%
    Cost per task
    Not tested
  206. 206
    GoogleDossier

    32,000 budget

    Score

    Gemini 2.5 Pro, Score: 4.9% (scale 0.0 to 100.0)4.9%
    Cost per task
    $0.76
  207. 206

    Score

    GLM-5, Score: 4.9% (scale 0.0 to 100.0)4.9%
    Cost per task
    $0.27
  208. 206
    MiniMaxDossier

    Score

    MiniMax M2.5, Score: 4.9% (scale 0.0 to 100.0)4.9%
    Cost per task
    $0.17
  209. 206
    OpenAIDossier

    high

    Score

    o3-pro, Score: 4.9% (scale 0.0 to 100.0)4.9%
    Cost per task
    $7.55
  210. 210
    OpenAIDossier

    low

    Score

    GPT-6 Luna, Score: 4.6% (scale 0.0 to 100.0)4.6%
    Cost per task
    Not tested
  211. 211
    AnthropicDossier

    8,000 budget

    Score

    Opus 4, Score: 4.5% (scale 0.0 to 100.0)4.5%
    Cost per task
    $1.16
  212. 212
    OpenAIDossier

    high

    Score

    GPT-5 mini, Score: 4.4% (scale 0.0 to 100.0)4.4%
    Cost per task
    $0.20
  213. 212
    OpenAIDossier

    medium

    Score

    GPT-5.4 mini, Score: 4.4% (scale 0.0 to 100.0)4.4%
    Cost per task
    $0.33
  214. 214
    DeepSeekDossier

    Score

    DeepSeek V3.2, Score: 4% (scale 0.0 to 100.0)4%
    Cost per task
    $0.12
  215. 214
    GoogleDossier

    16,000 budget

    Score

    Gemini 2.5 Pro, Score: 4% (scale 0.0 to 100.0)4%
    Cost per task
    $0.71
  216. 214
    OpenAIDossier

    medium

    Score

    GPT-5 mini, Score: 4% (scale 0.0 to 100.0)4%
    Cost per task
    $0.063
  217. 214
    AnthropicDossier

    32,000 budget

    Score

    Haiku 4.5, Score: 4% (scale 0.0 to 100.0)4%
    Cost per task
    $0.38
  218. 218
    Thinking MachinesDossier

    minimal

    Score

    Inkling Small, Score: 4% (scale 0.0 to 100.0)4%
    Cost per task
    Not tested
  219. 219
    AnthropicDossier

    Score

    Sonnet 4.5, Score: 3.8% (scale 0.0 to 100.0)3.8%
    Cost per task
    $0.13
  220. 220
    OpenAIDossier

    high

    Score

    GPT-5.4 nano, Score: 3.6% (scale 0.0 to 100.0)3.6%
    Cost per task
    $0.13
  221. 221
    GoogleDossier

    minimal

    Score

    Gemini 3 Flash Preview, Score: 3.3% (scale 0.0 to 100.0)3.3%
    Cost per task
    Not tested
  222. 222
    OpenAIDossier

    high

    Score

    o3-mini, Score: 3% (scale 0.0 to 100.0)3%
    Cost per task
    $0.55
  223. 223
    OpenAIDossier

    medium

    Score

    o3, Score: 3% (scale 0.0 to 100.0)3%
    Cost per task
    $0.48
  224. 224
    GoogleDossier

    8,000 budget

    Score

    Gemini 2.5 Pro, Score: 2.9% (scale 0.0 to 100.0)2.9%
    Cost per task
    $0.44
  225. 225
    AnthropicDossier

    16,000 budget

    Score

    Haiku 4.5, Score: 2.8% (scale 0.0 to 100.0)2.8%
    Cost per task
    $0.14
  226. 226
    ReflectionDossier

    low

    Score

    Beam 1.0, Score: 2.8% (scale 0.0 to 100.0)2.8%
    Cost per task
    Not tested
  227. 226
    AnthropicDossier

    low

    Score

    Haiku 5.5, Score: 2.8% (scale 0.0 to 100.0)2.8%
    Cost per task
    Not tested
  228. 228
    GoogleDossier

    minimal

    Score

    Gemini 3.6 Flash, Score: 2.6% (scale 0.0 to 100.0)2.6%
    Cost per task
    Not tested
  229. 229
    OpenAIDossier

    high

    Score

    GPT-5 nano, Score: 2.6% (scale 0.0 to 100.0)2.6%
    Cost per task
    $0.030
  230. 230
    GoogleDossier

    23,000 budget

    Score

    Gemini 2.5 Flash Preview (05-20), Score: 2.5% (scale 0.0 to 100.0)2.5%
    Cost per task
    $0.32
  231. 231
    OpenAIDossier

    medium

    Score

    o4-mini, Score: 2.4% (scale 0.0 to 100.0)2.4%
    Cost per task
    $0.23
  232. 232
    GoogleDossier

    1,000 budget

    Score

    Gemini 2.5 Flash Preview (05-20), Score: 2.2% (scale 0.0 to 100.0)2.2%
    Cost per task
    $0.030
  233. 233
    AnthropicDossier

    8,000 budget

    Score

    Claude Sonnet 4, Score: 2.1% (scale 0.0 to 100.0)2.1%
    Cost per task
    $0.27
  234. 233
    GoogleDossier

    8,000 budget

    Score

    Gemini 2.5 Flash Preview (05-20), Score: 2.1% (scale 0.0 to 100.0)2.1%
    Cost per task
    $0.20
  235. 235
    DeepSeekDossier

    none

    Score

    DeepSeek V4-Flash 0731, Score: 2.1% (scale 0.0 to 100.0)2.1%
    Cost per task
    Not tested
  236. 235
    DeepSeekDossier

    none

    Score

    DeepSeek V4.1 Flash 1017, Score: 2.1% (scale 0.0 to 100.0)2.1%
    Cost per task
    Not tested
  237. 237
    OpenAIDossier

    medium

    Score

    o3-mini, Score: 2.1% (scale 0.0 to 100.0)2.1%
    Cost per task
    $0.28
  238. 238
    OpenAIDossier

    low

    Score

    o3-pro, Score: 2.1% (scale 0.0 to 100.0)2.1%
    Cost per task
    $2.23
  239. 239
    OpenAIDossier

    low

    Score

    o3, Score: 2% (scale 0.0 to 100.0)2%
    Cost per task
    $0.23
  240. 240
    GoogleDossier

    16,000 budget

    Score

    Gemini 2.5 Flash Preview (05-20), Score: 2% (scale 0.0 to 100.0)2%
    Cost per task
    $0.32
  241. 241
    OpenAIDossier

    low

    Score

    GPT-5, Score: 1.9% (scale 0.0 to 100.0)1.9%
    Cost per task
    $0.19
  242. 241
    OpenAIDossier

    low

    Score

    GPT-5, Score: 1.9% (scale 0.0 to 100.0)1.9%
    Cost per task
    $0.19
  243. 241
    OpenAIDossier

    low · thinking

    Score

    GPT-5.1, Score: 1.9% (scale 0.0 to 100.0)1.9%
    Cost per task
    $0.13
  244. 241
    OpenAIDossier

    medium

    Score

    GPT-5.4 nano, Score: 1.9% (scale 0.0 to 100.0)1.9%
    Cost per task
    $0.060
  245. 241
    OpenAIDossier

    medium

    Score

    o3-pro, Score: 1.9% (scale 0.0 to 100.0)1.9%
    Cost per task
    $4.74
  246. 246
    GoogleDossier

    Score

    Gemini 2.5 Flash Preview (05-20), Score: 1.7% (scale 0.0 to 100.0)1.7%
    Cost per task
    $0.057
  247. 247
    OpenAIDossier

    minimal

    Score

    GPT-5 mini, Score: 1.7% (scale 0.0 to 100.0)1.7%
    Cost per task
    $0.009
  248. 247
    AnthropicDossier

    8,000 budget

    Score

    Haiku 4.5, Score: 1.7% (scale 0.0 to 100.0)1.7%
    Cost per task
    $0.091
  249. 247
    OpenAIDossier

    low

    Score

    o4-mini, Score: 1.7% (scale 0.0 to 100.0)1.7%
    Cost per task
    $0.050
  250. 250
    OpenAIDossier

    none

    Score

    GPT-6 Sol, Score: 1.7% (scale 0.0 to 100.0)1.7%
    Cost per task
    Not tested
  251. 251
    OpenAIDossier

    low

    Score

    GPT-5.4 nano, Score: 1.5% (scale 0.0 to 100.0)1.5%
    Cost per task
    $0.010
  252. 252
    GoogleDossier

    low

    Score

    Gemini 3.5 Flash-Lite, Score: 1.5% (scale 0.0 to 100.0)1.5%
    Cost per task
    Not tested
  253. 252
    AlibabaDossier

    none

    Score

    Qwen3.8-27B, Score: 1.5% (scale 0.0 to 100.0)1.5%
    Cost per task
    Not tested
  254. 254
    DeepSeekDossier

    Score

    DeepSeek R1 (Jan '25), Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.080
  255. 254
    GoogleDossier

    Score

    Gemini 2.0 Flash (001), Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.004
  256. 256
    AnthropicDossier

    Score

    Claude Sonnet 4, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.13
  257. 256
    OpenAIDossier

    Score

    Codex mini, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.23
  258. 256
    AnthropicDossier

    Score

    Opus 4, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.64
  259. 259
    DeepSeekDossier

    none

    Score

    DeepSeek V4.1 Flash, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    Not tested
  260. 259
    GoogleDossier

    low

    Score

    Gemini 3 Flash Preview, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    Not tested
  261. 259
    AnthropicDossier

    Score

    Haiku 4.5, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.043
  262. 259
    AnthropicDossier

    1,000 budget

    Score

    Haiku 4.5, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.047
  263. 259
    AlibabaDossier

    Score

    Qwen3 235B A22B 2507 Instruct, Score: 1.3% (scale 0.0 to 100.0)1.3%
    Cost per task
    $0.004
  264. 264
    DeepSeekDossier

    Score

    DeepSeek R1 0528, Score: 1.1% (scale 0.0 to 100.0)1.1%
    Cost per task
    $0.053
  265. 265
    OpenAIDossier

    low

    Score

    GPT-5.4 mini, Score: 1.1% (scale 0.0 to 100.0)1.1%
    Cost per task
    $0.060
  266. 266
    AnthropicDossier

    8,000 budget

    Score

    Claude 3.7 Sonnet, Score: 0.9% (scale 0.0 to 100.0)0.9%
    Cost per task
    $0.36
  267. 267
    OpenAIDossier

    medium

    Score

    GPT-5 nano, Score: 0.9% (scale 0.0 to 100.0)0.9%
    Cost per task
    $0.014
  268. 268
    AnthropicDossier

    1,000 budget

    Score

    Claude Sonnet 4, Score: 0.9% (scale 0.0 to 100.0)0.9%
    Cost per task
    $0.14
  269. 269
    DeepSeekDossier

    none

    Score

    DeepSeek V4 Pro 0813, Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    Not tested
  270. 269
    GoogleDossier

    minimal

    Score

    Gemini 3.5 Flash-Lite, Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    Not tested
  271. 271
    OpenAIDossier

    low

    Score

    GPT-5 mini, Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    $0.019
  272. 271
    OpenAIDossier

    Score

    GPT-5.2, Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    Not tested
  273. 271
    OpenAIDossier

    Score

    o1-mini, Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    $0.19
  274. 274
    GoogleDossier

    Score

    Gemini 1.5 Pro (002), Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    $0.040
  275. 274
    OpenAIDossier

    Score

    GPT-4.5 Preview, Score: 0.8% (scale 0.0 to 100.0)0.8%
    Cost per task
    $2.10
  276. 276
    AnthropicDossier

    16,000 budget

    Score

    Claude 3.7 Sonnet, Score: 0.7% (scale 0.0 to 100.0)0.7%
    Cost per task
    $0.51
  277. 277
    OpenAIDossier

    Score

    GPT-4.1, Score: 0.4% (scale 0.0 to 100.0)0.4%
    Cost per task
    $0.069
  278. 277
    OpenAIDossier

    none · thinking

    Score

    GPT-5.1, Score: 0.4% (scale 0.0 to 100.0)0.4%
    Cost per task
    $0.058
  279. 277

    low

    Score

    Grok 3 mini, Score: 0.4% (scale 0.0 to 100.0)0.4%
    Cost per task
    $0.013
  280. 280
    AnthropicDossier

    1,000 budget

    Score

    Claude 3.7 Sonnet, Score: 0.4% (scale 0.0 to 100.0)0.4%
    Cost per task
    $0.14
  281. 281
    AnthropicDossier

    Score

    Claude 3.7 Sonnet, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.12
  282. 281
    GoogleDossier

    1,000 budget

    Score

    Gemini 2.5 Pro Preview (06-05), Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.089
  283. 281
    OpenAIDossier

    Score

    GPT-4.1 mini, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.014
  284. 281
    OpenAIDossier

    Score

    GPT-4.1 nano, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.004
  285. 281
    OpenAIDossier

    Score

    GPT-4o (Nov '24), Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.080
  286. 281
    OpenAIDossier

    Score

    GPT-4o mini, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.010
  287. 281
    OpenAIDossier

    minimal

    Score

    GPT-5, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.056
  288. 281
    OpenAIDossier

    low

    Score

    GPT-5 nano, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.003
  289. 281
    OpenAIDossier

    minimal

    Score

    GPT-5 nano, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.003
  290. 281
    OpenAIDossier

    none

    Score

    GPT-6 Luna, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    Not tested
  291. 281

    Score

    Grok 3, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.14
  292. 281
    Thinking MachinesDossier

    none

    Score

    Inkling Small, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    Not tested
  293. 281

    Score

    Llama 4 Maverick, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.012
  294. 281

    Score

    Llama 4 Scout, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.006
  295. 281
    MistralDossier

    Score

    Magistral Medium (2506), Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    Not tested
  296. 281
    MistralDossier

    thinking

    Score

    Magistral Medium (2506), Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    Not tested
  297. 281
    MistralDossier

    Score

    Magistral Small (2506), Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.049
  298. 281
    OpenAIDossier

    low

    Score

    o3-mini, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.062
  299. 281
    AnthropicDossier

    1,000 budget

    Score

    Opus 4, Score: 0% (scale 0.0 to 100.0)0%
    Cost per task
    $0.75