Finance Agent
Finance Agent, a component of the Vals Index.
No filters. Showing 38 of 38 rows.
1[1–11] AnthropicDossier | high | No harness | Fable 5.2, Accuracy: 69.5% (scale 0.0 to 100.0), 95% confidence interval 65.6 to 73.369.5%(65.6–73.3) | 207.6 s | $4.83 | Runs unstated | Cost kind unknown |
2[1–16] AnthropicDossierTied #1 | max | No harness | Opus 5.5, Accuracy: 67.8% (scale 0.0 to 100.0), 95% confidence interval 63.8 to 71.967.8%(63.8–71.9) | 1,980.1 s | $8.91 | Runs unstated | Cost kind unknown |
3[1–15] GoogleDossierTied #1 | high | No harness | Gemini 4 Argon, Accuracy: 67.7% (scale 0.0 to 100.0), 95% confidence interval 63.7 to 71.667.7%(63.7–71.6) | 793 s | $4.32 | Runs unstated | Cost kind unknown |
4[1–16] MetaDossierTied #1 | max | No harness | Muse Wonder Full 1.0, Accuracy: 67.6% (scale 0.0 to 100.0), 95% confidence interval 63.7 to 71.567.6%(63.7–71.5) | 850.3 s | $2.68 | Runs unstated | Cost kind unknown |
5[1–14] Thinking MachinesDossierTied #1 | No effort set | No harness | Inkling 2 Small, Accuracy: 67.5% (scale 0.0 to 100.0), 95% confidence interval 63.6 to 71.567.5%(63.6–71.5) | 296.3 s | $0.18 | Runs unstated | Cost kind unknown |
6[1–17] AnthropicDossierTied #1 | max | No harness | Sonnet 5.5, Accuracy: 67.3% (scale 0.0 to 100.0), 95% confidence interval 63.3 to 71.267.3%(63.3–71.2) | 2,066.2 s | $6.95 | Runs unstated | Cost kind unknown |
7[1–20] GoogleDossierTied #1 | high | No harness | Gemini 4 Carbon, Accuracy: 67.2% (scale 0.0 to 100.0), 95% confidence interval 63.2 to 71.167.2%(63.2–71.1) | 1,779.6 s | $7.29 | Runs unstated | Cost kind unknown |
8[1–18] AlibabaDossierTied #1 | xhigh | No harness | Qwen4 Max, Accuracy: 66.7% (scale 0.0 to 100.0), 95% confidence interval 62.7 to 70.666.7%(62.7–70.6) | 1,465.3 s | $1.74 | Runs unstated | Cost kind unknown |
9[1–21] GoogleDossierTied #1 | high | No harness | Gemini 3.8 Flash, Accuracy: 65.8% (scale 0.0 to 100.0), 95% confidence interval 61.8 to 69.865.8%(61.8–69.8) | 443.9 s | $1.99 | Runs unstated | Cost kind unknown |
10[2–20] MetaDossierTied #1 | max | No harness | Muse Wonder 1.0, Accuracy: 65.5% (scale 0.0 to 100.0), 95% confidence interval 61.6 to 69.565.5%(61.6–69.5) | 310.1 s | $2.62 | Runs unstated | Cost kind unknown |
11[2–23] AnthropicDossierTied #1 | max | No harness | Haiku 5.5, Accuracy: 65.4% (scale 0.0 to 100.0), 95% confidence interval 61.3 to 69.465.4%(61.3–69.4) | 1,864.6 s | $1.64 | Runs unstated | Cost kind unknown |
12[3–22] GoogleDossierTied #1 | xhigh | No harness | Gemini 4 Hydrogen, Accuracy: 65.1% (scale 0.0 to 100.0), 95% confidence interval 61.1 to 69.165.1%(61.1–69.1) | 1,078.1 s | $4.36 | Runs unstated | Cost kind unknown |
13[3–21] Z.aiDossierTied #1 | max | No harness | GLM-5.3, Accuracy: 65% (scale 0.0 to 100.0), 95% confidence interval 61.1 to 68.965%(61.1–68.9) | 1,205.6 s | $1.03 | Runs unstated | Cost kind unknown |
14[3–23] TencentDossierTied #1 | No effort set | No harness | Hy4, Accuracy: 64.7% (scale 0.0 to 100.0), 95% confidence interval 60.7 to 68.764.7%(60.7–68.7) | 2,238.9 s | $1.28 | Runs unstated | Cost kind unknown |
15[4–24] XiaomiDossierTied #1 | No effort set | No harness | MiMo-V2.6-Pro, Accuracy: 64.3% (scale 0.0 to 100.0), 95% confidence interval 60.3 to 68.264.3%(60.3–68.2) | 682 s | $0.18 | Runs unstated | Cost kind unknown |
16[4–26] MetaDossier | max | No harness | Muse Ember, Accuracy: 63.8% (scale 0.0 to 100.0), 95% confidence interval 59.9 to 67.863.8%(59.9–67.8) | 89.4 s | $0.056 | Runs unstated | Cost kind unknown |
17[7–27] XiaomiDossier | No effort set | No harness | MiMo-V2.6-Flash, Accuracy: 63.3% (scale 0.0 to 100.0), 95% confidence interval 59.2 to 67.463.3%(59.2–67.4) | 936.3 s | $0.067 | Runs unstated | Cost kind unknown |
18[8–28] DeepSeekDossier | max | No harness | DeepSeek V4.1 Flash 1017, Accuracy: 62.9% (scale 0.0 to 100.0), 95% confidence interval 59.0 to 66.962.9%(59.0–66.9) | 909.2 s | $0.47 | Runs unstated | Cost kind unknown |
19[10–30] OpenAIDossier | max | No harness | GPT-6.1 Sol, Accuracy: 61.8% (scale 0.0 to 100.0), 95% confidence interval 57.7 to 66.061.8%(57.7–66.0) | 1,145.1 s | $1.63 | Runs unstated | Cost kind unknown |
20[10–29] MistralDossier | high | No harness | Mistral Large 4 OSS, Accuracy: 61.7% (scale 0.0 to 100.0), 95% confidence interval 57.7 to 65.761.7%(57.7–65.7) | 387.2 s | $0.35 | Runs unstated | Cost kind unknown |
21[11–31] TencentDossier | No effort set | No harness | Hy4 Preview, Accuracy: 61.6% (scale 0.0 to 100.0), 95% confidence interval 57.6 to 65.761.6%(57.6–65.7) | 1,502.7 s | $0.67 | Runs unstated | Cost kind unknown |
22[11–31] Moonshot AIDossier | max | No harness | Kimi K3.1 Pro, Accuracy: 61.5% (scale 0.0 to 100.0), 95% confidence interval 57.4 to 65.661.5%(57.4–65.6) | 2,099 s | $2.29 | Runs unstated | Cost kind unknown |
23[13–31] MetaDossier | xhigh | No harness | Muse Spark Open, Accuracy: 60.7% (scale 0.0 to 100.0), 95% confidence interval 56.6 to 64.760.7%(56.6–64.7) | 1,612.3 s | $2.76 | Runs unstated | Cost kind unknown |
24[14–32] Z.aiDossier | max | No harness | GLM-5.3 Flash, Accuracy: 60.6% (scale 0.0 to 100.0), 95% confidence interval 56.6 to 64.660.6%(56.6–64.6) | 296.1 s | $0.072 | Runs unstated | Cost kind unknown |
25[14–32] xAIDossier | xhigh | No harness | Grok 4.7, Accuracy: 60.6% (scale 0.0 to 100.0), 95% confidence interval 56.4 to 64.760.6%(56.4–64.7) | 652.3 s | $2.24 | Runs unstated | Cost kind unknown |
26[12–32] OpenAIDossier | max | No harness | GPT-6 Astra, Accuracy: 60.4% (scale 0.0 to 100.0), 95% confidence interval 56.3 to 64.660.4%(56.3–64.6) | 1,228.8 s | $7.82 | Runs unstated | Cost kind unknown |
27[15–32] Moonshot AIDossier | max | No harness | Kimi K3, Accuracy: 60% (scale 0.0 to 100.0), 95% confidence interval 55.9 to 64.160%(55.9–64.1) | 875 s | $1.88 | Runs unstated | Cost kind unknown |
28[20–33] StepFunDossier | No effort set | No harness | Step 5 Preview, Accuracy: 58.9% (scale 0.0 to 100.0), 95% confidence interval 54.9 to 62.958.9%(54.9–62.9) | 542.5 s | $0.58 | Runs unstated | Cost kind unknown |
29[18–33] AlibabaDossier | No effort set | No harness | Qwen3.8 Max Internal, Accuracy: 58.8% (scale 0.0 to 100.0), 95% confidence interval 54.7 to 63.058.8%(54.7–63.0) | 3,319.6 s | $2.99 | Runs unstated | Cost kind unknown |
30[17–34] MiniMaxDossier | max | No harness | MiniMax M3.1 Flash, Accuracy: 58.8% (scale 0.0 to 100.0), 95% confidence interval 54.8 to 62.958.8%(54.8–62.9) | 904.2 s | $0.16 | Runs unstated | Cost kind unknown |
31[24–35] DeepSeekDossier | max | No harness | DeepSeek V4 Pro 0813, Accuracy: 57.1% (scale 0.0 to 100.0), 95% confidence interval 53.0 to 61.257.1%(53.0–61.2) | 477 s | $0.82 | Runs unstated | Cost kind unknown |
32[24–35] OpenAIDossier | max | No harness | GPT-6 Luna, Accuracy: 56.8% (scale 0.0 to 100.0), 95% confidence interval 52.7 to 61.056.8%(52.7–61.0) | 926.9 s | $0.12 | Runs unstated | Cost kind unknown |
33[24–35] OpenAIDossier | max | No harness | GPT-6.1 Terra, Accuracy: 56% (scale 0.0 to 100.0), 95% confidence interval 51.9 to 60.156%(51.9–60.1) | 1,787.1 s | $1.92 | Runs unstated | Cost kind unknown |
34[29–35] InceptionDossier | high | No harness | Mercury 3, Accuracy: 54.7% (scale 0.0 to 100.0), 95% confidence interval 50.8 to 58.654.7%(50.8–58.6) | 232.8 s | $0.065 | Runs unstated | Cost kind unknown |
35[32–37] ReflectionDossier | No effort set | No harness | Beam 1.0, Accuracy: 51.8% (scale 0.0 to 100.0), 95% confidence interval 47.7 to 56.051.8%(47.7–56.0) | 85.4 s | Not tested | Runs unstated | Cost kind unknown |
36[34–37] Thinking MachinesDossier | No effort set | No harness | Inkling, Accuracy: 49.9% (scale 0.0 to 100.0), 95% confidence interval 45.7 to 54.049.9%(45.7–54.0) | 573.7 s | $0.89 | Runs unstated | Cost kind unknown |
37[35–38] NVIDIADossier | high | No harness | Nemotron 3.5 Super VL, Accuracy: 47.7% (scale 0.0 to 100.0), 95% confidence interval 43.6 to 51.847.7%(43.6–51.8) | 79.5 s | $0.11 | Runs unstated | Cost kind unknown |
38[37–38] Thinking MachinesDossier | No effort set | No harness | Inkling Small, Accuracy: 44.8% (scale 0.0 to 100.0), 95% confidence interval 40.7 to 48.944.8%(40.7–48.9) | 314.2 s | $0.21 | Runs unstated | Cost kind unknown |
- 1AnthropicDossier
high
Accuracy
Fable 5.2, Accuracy: 69.5% (scale 0.0 to 100.0), 95% confidence interval 65.6 to 73.369.5%(65.6–73.3)- Duration per test
- 207.6 s
- Cost per test
- $4.83
Accuracy
Opus 5.5, Accuracy: 67.8% (scale 0.0 to 100.0), 95% confidence interval 63.8 to 71.967.8%(63.8–71.9)- Duration per test
- 1,980.1 s
- Cost per test
- $8.91
Accuracy
Gemini 4 Argon, Accuracy: 67.7% (scale 0.0 to 100.0), 95% confidence interval 63.7 to 71.667.7%(63.7–71.6)- Duration per test
- 793 s
- Cost per test
- $4.32
Accuracy
Muse Wonder Full 1.0, Accuracy: 67.6% (scale 0.0 to 100.0), 95% confidence interval 63.7 to 71.567.6%(63.7–71.5)- Duration per test
- 850.3 s
- Cost per test
- $2.68
Accuracy
Inkling 2 Small, Accuracy: 67.5% (scale 0.0 to 100.0), 95% confidence interval 63.6 to 71.567.5%(63.6–71.5)- Duration per test
- 296.3 s
- Cost per test
- $0.18
Accuracy
Sonnet 5.5, Accuracy: 67.3% (scale 0.0 to 100.0), 95% confidence interval 63.3 to 71.267.3%(63.3–71.2)- Duration per test
- 2,066.2 s
- Cost per test
- $6.95
Accuracy
Gemini 4 Carbon, Accuracy: 67.2% (scale 0.0 to 100.0), 95% confidence interval 63.2 to 71.167.2%(63.2–71.1)- Duration per test
- 1,779.6 s
- Cost per test
- $7.29
Accuracy
Qwen4 Max, Accuracy: 66.7% (scale 0.0 to 100.0), 95% confidence interval 62.7 to 70.666.7%(62.7–70.6)- Duration per test
- 1,465.3 s
- Cost per test
- $1.74
Accuracy
Gemini 3.8 Flash, Accuracy: 65.8% (scale 0.0 to 100.0), 95% confidence interval 61.8 to 69.865.8%(61.8–69.8)- Duration per test
- 443.9 s
- Cost per test
- $1.99
Accuracy
Muse Wonder 1.0, Accuracy: 65.5% (scale 0.0 to 100.0), 95% confidence interval 61.6 to 69.565.5%(61.6–69.5)- Duration per test
- 310.1 s
- Cost per test
- $2.62
Accuracy
Haiku 5.5, Accuracy: 65.4% (scale 0.0 to 100.0), 95% confidence interval 61.3 to 69.465.4%(61.3–69.4)- Duration per test
- 1,864.6 s
- Cost per test
- $1.64
Accuracy
Gemini 4 Hydrogen, Accuracy: 65.1% (scale 0.0 to 100.0), 95% confidence interval 61.1 to 69.165.1%(61.1–69.1)- Duration per test
- 1,078.1 s
- Cost per test
- $4.36
Accuracy
GLM-5.3, Accuracy: 65% (scale 0.0 to 100.0), 95% confidence interval 61.1 to 68.965%(61.1–68.9)- Duration per test
- 1,205.6 s
- Cost per test
- $1.03
Accuracy
Hy4, Accuracy: 64.7% (scale 0.0 to 100.0), 95% confidence interval 60.7 to 68.764.7%(60.7–68.7)- Duration per test
- 2,238.9 s
- Cost per test
- $1.28
Accuracy
MiMo-V2.6-Pro, Accuracy: 64.3% (scale 0.0 to 100.0), 95% confidence interval 60.3 to 68.264.3%(60.3–68.2)- Duration per test
- 682 s
- Cost per test
- $0.18
- 16MetaDossier
max
Accuracy
Muse Ember, Accuracy: 63.8% (scale 0.0 to 100.0), 95% confidence interval 59.9 to 67.863.8%(59.9–67.8)- Duration per test
- 89.4 s
- Cost per test
- $0.056
- 17XiaomiDossier
Accuracy
MiMo-V2.6-Flash, Accuracy: 63.3% (scale 0.0 to 100.0), 95% confidence interval 59.2 to 67.463.3%(59.2–67.4)- Duration per test
- 936.3 s
- Cost per test
- $0.067
- 18DeepSeekDossier
max
Accuracy
DeepSeek V4.1 Flash 1017, Accuracy: 62.9% (scale 0.0 to 100.0), 95% confidence interval 59.0 to 66.962.9%(59.0–66.9)- Duration per test
- 909.2 s
- Cost per test
- $0.47
- 19OpenAIDossier
max
Accuracy
GPT-6.1 Sol, Accuracy: 61.8% (scale 0.0 to 100.0), 95% confidence interval 57.7 to 66.061.8%(57.7–66.0)- Duration per test
- 1,145.1 s
- Cost per test
- $1.63
- 20MistralDossier
high
Accuracy
Mistral Large 4 OSS, Accuracy: 61.7% (scale 0.0 to 100.0), 95% confidence interval 57.7 to 65.761.7%(57.7–65.7)- Duration per test
- 387.2 s
- Cost per test
- $0.35
- 21TencentDossier
Accuracy
Hy4 Preview, Accuracy: 61.6% (scale 0.0 to 100.0), 95% confidence interval 57.6 to 65.761.6%(57.6–65.7)- Duration per test
- 1,502.7 s
- Cost per test
- $0.67
- 22Moonshot AIDossier
max
Accuracy
Kimi K3.1 Pro, Accuracy: 61.5% (scale 0.0 to 100.0), 95% confidence interval 57.4 to 65.661.5%(57.4–65.6)- Duration per test
- 2,099 s
- Cost per test
- $2.29
- 23MetaDossier
xhigh
Accuracy
Muse Spark Open, Accuracy: 60.7% (scale 0.0 to 100.0), 95% confidence interval 56.6 to 64.760.7%(56.6–64.7)- Duration per test
- 1,612.3 s
- Cost per test
- $2.76
- 24Z.aiDossier
max
Accuracy
GLM-5.3 Flash, Accuracy: 60.6% (scale 0.0 to 100.0), 95% confidence interval 56.6 to 64.660.6%(56.6–64.6)- Duration per test
- 296.1 s
- Cost per test
- $0.072
- 25xAIDossier
xhigh
Accuracy
Grok 4.7, Accuracy: 60.6% (scale 0.0 to 100.0), 95% confidence interval 56.4 to 64.760.6%(56.4–64.7)- Duration per test
- 652.3 s
- Cost per test
- $2.24
- 26OpenAIDossier
max
Accuracy
GPT-6 Astra, Accuracy: 60.4% (scale 0.0 to 100.0), 95% confidence interval 56.3 to 64.660.4%(56.3–64.6)- Duration per test
- 1,228.8 s
- Cost per test
- $7.82
- 27Moonshot AIDossier
max
Accuracy
Kimi K3, Accuracy: 60% (scale 0.0 to 100.0), 95% confidence interval 55.9 to 64.160%(55.9–64.1)- Duration per test
- 875 s
- Cost per test
- $1.88
- 28StepFunDossier
Accuracy
Step 5 Preview, Accuracy: 58.9% (scale 0.0 to 100.0), 95% confidence interval 54.9 to 62.958.9%(54.9–62.9)- Duration per test
- 542.5 s
- Cost per test
- $0.58
- 29AlibabaDossier
Accuracy
Qwen3.8 Max Internal, Accuracy: 58.8% (scale 0.0 to 100.0), 95% confidence interval 54.7 to 63.058.8%(54.7–63.0)- Duration per test
- 3,319.6 s
- Cost per test
- $2.99
- 30MiniMaxDossier
max
Accuracy
MiniMax M3.1 Flash, Accuracy: 58.8% (scale 0.0 to 100.0), 95% confidence interval 54.8 to 62.958.8%(54.8–62.9)- Duration per test
- 904.2 s
- Cost per test
- $0.16
- 31DeepSeekDossier
max
Accuracy
DeepSeek V4 Pro 0813, Accuracy: 57.1% (scale 0.0 to 100.0), 95% confidence interval 53.0 to 61.257.1%(53.0–61.2)- Duration per test
- 477 s
- Cost per test
- $0.82
- 32OpenAIDossier
max
Accuracy
GPT-6 Luna, Accuracy: 56.8% (scale 0.0 to 100.0), 95% confidence interval 52.7 to 61.056.8%(52.7–61.0)- Duration per test
- 926.9 s
- Cost per test
- $0.12
- 33OpenAIDossier
max
Accuracy
GPT-6.1 Terra, Accuracy: 56% (scale 0.0 to 100.0), 95% confidence interval 51.9 to 60.156%(51.9–60.1)- Duration per test
- 1,787.1 s
- Cost per test
- $1.92
- 34InceptionDossier
high
Accuracy
Mercury 3, Accuracy: 54.7% (scale 0.0 to 100.0), 95% confidence interval 50.8 to 58.654.7%(50.8–58.6)- Duration per test
- 232.8 s
- Cost per test
- $0.065
- 35ReflectionDossier
Accuracy
Beam 1.0, Accuracy: 51.8% (scale 0.0 to 100.0), 95% confidence interval 47.7 to 56.051.8%(47.7–56.0)- Duration per test
- 85.4 s
- Cost per test
- Not tested
- 36Thinking MachinesDossier
Accuracy
Inkling, Accuracy: 49.9% (scale 0.0 to 100.0), 95% confidence interval 45.7 to 54.049.9%(45.7–54.0)- Duration per test
- 573.7 s
- Cost per test
- $0.89
- 37NVIDIADossier
high
Accuracy
Nemotron 3.5 Super VL, Accuracy: 47.7% (scale 0.0 to 100.0), 95% confidence interval 43.6 to 51.847.7%(43.6–51.8)- Duration per test
- 79.5 s
- Cost per test
- $0.11
- 38Thinking MachinesDossier
Accuracy
Inkling Small, Accuracy: 44.8% (scale 0.0 to 100.0), 95% confidence interval 40.7 to 48.944.8%(40.7–48.9)- Duration per test
- 314.2 s
- Cost per test
- $0.21