Acropolis

METR time horizon

Length of tasks, measured in human working time, that a model completes with 50 percent or 80 percent success. Run on METR's long-task suite.

AgenticCoding
Independent. Run by an operator independent of the model vendors.METR time horizons by METRVersion 1.1Data as of 15 Nov 2026

Time horizon doubling time, as METR publishes it: 129 days (104 to 158) since 2023, 188 days over all time.

No filters. Showing 23 of 23 rows.

  1. 1
    AnthropicDossier

    metr_agents/react

    50% time horizon

    Claude Mythos Preview (early), 50% time horizon: 1,044.8 min (scale 0.0 to 1044.8), 95% confidence interval 508.9 to 3304.31,044.8 min(508.9–3304.3)
    80% time horizon
    185.9 min
    Average score
    0.9
  2. 2
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Opus 4.6, 50% time horizon: 718.8 min (scale 0.0 to 1044.8), 95% confidence interval 316.7 to 3633.8718.8 min(316.7–3633.8)
    80% time horizon
    69.9 min
    Average score
    0.8
  3. 3
    GoogleDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    Gemini 3.1 Pro Preview, 50% time horizon: 384.1 min (scale 0.0 to 1044.8), 95% confidence interval 233.5 to 694.8384.1 min(233.5–694.8)
    80% time horizon
    89.8 min
    Average score
    0.8
  4. 4
    OpenAIDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    GPT-5.2, 50% time horizon: 352.2 min (scale 0.0 to 1044.8), 95% confidence interval 198.1 to 815.2352.2 min(198.1–815.2)
    80% time horizon
    66 min
    Average score
    0.8
  5. 5
    OpenAIDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    GPT-5.3 Codex, 50% time horizon: 349.5 min (scale 0.0 to 1044.8), 95% confidence interval 194.9 to 816.4349.5 min(194.9–816.4)
    80% time horizon
    54.7 min
    Average score
    0.7
  6. 6
    OpenAIDossier

    metr_agents/react

    Tied #1

    50% time horizon

    GPT-5.4, 50% time horizon: 341.7 min (scale 0.0 to 1044.8), 95% confidence interval 186.6 to 768.8341.7 min(186.6–768.8)
    80% time horizon
    53.9 min
    Average score
    0.7
  7. 7
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Opus 4.5, 50% time horizon: 293 min (scale 0.0 to 1044.8), 95% confidence interval 161.7 to 623.7293 min(161.7–623.7)
    80% time horizon
    49.4 min
    Average score
    0.7
  8. 8
    GoogleDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Gemini 3 Pro Preview, 50% time horizon: 224.3 min (scale 0.0 to 1044.8), 95% confidence interval 139.6 to 379.2224.3 min(139.6–379.2)
    80% time horizon
    54.1 min
    Average score
    0.7
  9. 9
    OpenAIDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    GPT-5.1 Codex Max, 50% time horizon: 223.7 min (scale 0.0 to 1044.8), 95% confidence interval 134.3 to 396.2223.7 min(134.3–396.2)
    80% time horizon
    50.6 min
    Average score
    0.7
  10. 10
    OpenAIDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    GPT-5, 50% time horizon: 203 min (scale 0.0 to 1044.8), 95% confidence interval 112.6 to 405.6203 min(112.6–405.6)
    80% time horizon
    38.3 min
    Average score
    0.7
  11. 11
    OpenAIDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    o3, 50% time horizon: 119.7 min (scale 0.0 to 1044.8), 95% confidence interval 74.6 to 190.9119.7 min(74.6–190.9)
    80% time horizon
    30 min
    Average score
    0.6
  12. 12
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Opus 4.1, 50% time horizon: 100.5 min (scale 0.0 to 1044.8), 95% confidence interval 59.3 to 159.5100.5 min(59.3–159.5)
    80% time horizon
    23.5 min
    Average score
    0.6
  13. 13
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Opus 4, 50% time horizon: 100.4 min (scale 0.0 to 1044.8), 95% confidence interval 60.0 to 163.5100.4 min(60.0–163.5)
    80% time horizon
    20.4 min
    Average score
    0.6
  14. 14
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Claude 3.7 Sonnet, 50% time horizon: 60.4 min (scale 0.0 to 1044.8), 95% confidence interval 33.0 to 104.260.4 min(33.0–104.2)
    80% time horizon
    12.1 min
    Average score
    0.6
  15. 15
    OpenAIDossier

    triframe_inspect/triframe_agent

    Tied #1

    50% time horizon

    o1, 50% time horizon: 38.8 min (scale 0.0 to 1044.8), 95% confidence interval 21.2 to 65.038.8 min(21.2–65.0)
    80% time horizon
    7.1 min
    Average score
    0.5
  16. 16
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Claude 3.5 Sonnet (Oct '24), 50% time horizon: 20.5 min (scale 0.0 to 1044.8), 95% confidence interval 10.1 to 40.820.5 min(10.1–40.8)
    80% time horizon
    2.6 min
    Average score
    0.5
  17. 17
    OpenAIDossier

    duet

    Tied #1

    50% time horizon

    o1-preview, 50% time horizon: 20.3 min (scale 0.0 to 1044.8), 95% confidence interval 11.7 to 33.420.3 min(11.7–33.4)
    80% time horizon
    4.4 min
    Average score
    0.5
  18. 18
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Claude 3.5 Sonnet (June '24), 50% time horizon: 11.4 min (scale 0.0 to 1044.8), 95% confidence interval 5.5 to 22.411.4 min(5.5–22.4)
    80% time horizon
    1.7 min
    Average score
    0.4
  19. 19
    OpenAIDossier

    metr_agents/react

    Tied #1

    50% time horizon

    GPT-4o (May '24), 50% time horizon: 7 min (scale 0.0 to 1044.8), 95% confidence interval 4.0 to 12.97 min(4.0–12.9)
    80% time horizon
    1.3 min
    Average score
    0.3
  20. 20
    OpenAIDossier

    metr_agents/react

    Tied #1

    50% time horizon

    GPT-4 Turbo Preview (1106), 50% time horizon: 4 min (scale 0.0 to 1044.8), 95% confidence interval 1.9 to 8.44 min(1.9–8.4)
    80% time horizon
    0.8 min
    Average score
    0.3
  21. 21
    OpenAIDossier

    modular-public

    Tied #1

    50% time horizon

    GPT-4 (0314), 50% time horizon: 4 min (scale 0.0 to 1044.8), 95% confidence interval 1.9 to 8.04 min(1.9–8.0)
    80% time horizon
    0.9 min
    Average score
    0.3
  22. 22
    AnthropicDossier

    metr_agents/react

    Tied #1

    50% time horizon

    Claude 3 Opus, 50% time horizon: 4 min (scale 0.0 to 1044.8), 95% confidence interval 1.7 to 8.84 min(1.7–8.8)
    80% time horizon
    0.6 min
    Average score
    0.3
  23. 23
    OpenAIDossier

    metr_agents/react

    Tied #1

    50% time horizon

    GPT-4 Turbo, 50% time horizon: 3.7 min (scale 0.0 to 1044.8), 95% confidence interval 2.0 to 6.73.7 min(2.0–6.7)
    80% time horizon
    0.9 min
    Average score
    0.3