Every real run, newest first unless a column says otherwise. Open one to see the page the agent wrote, its violations and what each step cost.
| Task | Model | Context | Design system | Quality | Done | Steps | Cost | When ↑ |
|---|---|---|---|---|---|---|---|---|
| statement | nemotron-3.5-lightning-free | none | 20 | 20 | Incomplete | 3 | $0.0000 | Nov 8, 22:06 |
113 runs match.
| statement | gpt-6-luna | none | 146 | 25 | Done | 4 | $0.0026 | Nov 8, 22:29 |
| statement | gpt-6-luna | none | 115 | 17 | Done | 5 | $0.0049 | Nov 8, 23:10 |
| statement | claude-haiku-5.5 | none | 39 | 12 | Done | 3 | $0.0020 | Nov 8, 23:32 |
| kyc-form | claude-haiku-5.5 | none | 31 | 5 | Done | 4 | $0.0034 | Nov 8, 23:51 |
| loan-contract | claude-haiku-5.5 | none | 35 | 9 | Done | 3 | $0.0028 | Nov 8, 23:51 |
| payment-approval | claude-haiku-5.5 | none | 53 | 13 | Done | 4 | $0.0028 | Nov 8, 23:51 |
| statement | claude-haiku-5.5 | none | 45 | 8 | Done | 3 | $0.0018 | Nov 8, 23:52 |
| transfer-form | claude-haiku-5.5 | none | 21 | 5 | Done | 3 | $0.0037 | Nov 8, 23:52 |
| kyc-form | claude-haiku-5.5 | none | 40 | 9 | Incomplete | 3 | $0.0039 | Nov 8, 23:58 |
| loan-contract | claude-haiku-5.5 | none | 32 | 8 | Done | 3 | $0.0024 | Nov 8, 23:58 |
| payment-approval | claude-haiku-5.5 | none | 62 | 19 | Done | 3 | $0.0027 | Nov 8, 23:58 |
| statement | claude-haiku-5.5 | none | 37 | 10 | Done | 3 | $0.0019 | Nov 8, 23:58 |
| transfer-form | claude-haiku-5.5 | none | 25 | 7 | Done | 3 | $0.0031 | Nov 8, 23:59 |
| kyc-form | claude-haiku-5.5 | none | 45 | 2 | Done | 3 | $0.0032 | Nov 9, 00:04 |
| loan-contract | claude-haiku-5.5 | none | 19 | 8 | Done | 3 | $0.0028 | Nov 9, 00:04 |
| payment-approval | claude-haiku-5.5 | none | 25 | 7 | Done | 4 | $0.0040 | Nov 9, 00:05 |
| statement | claude-haiku-5.5 | none | 42 | 7 | Done | 3 | $0.0018 | Nov 9, 00:05 |
| transfer-form | claude-haiku-5.5 | none | 33 | 9 | Done | 4 | $0.0055 | Nov 9, 00:05 |
| kyc-form | gpt-6-luna | none | 201 | 30 | Done | 4 | $0.0033 | Nov 9, 00:17 |
| loan-contract | gpt-6-luna | none | 229 | 43 | Done | 4 | $0.0030 | Nov 9, 00:17 |
| payment-approval | gpt-6-luna | none | 0 | 10 | Incomplete | 4 | $0.0045 | Nov 9, 00:18 |
| statement | gpt-6-luna | none | 146 | 18 | Done | 4 | $0.0024 | Nov 9, 00:19 |
| transfer-form | gpt-6-luna | none | 155 | 44 | Done | 4 | $0.0030 | Nov 9, 00:20 |
| kyc-form | deepseek-v4.1-flash-1017 | none | 42 | 13 | Done | 4 | $0.0102 | Nov 9, 09:00 |
| loan-contract | deepseek-v4.1-flash-1017 | none | 145 | 24 | Done | 5 | $0.0184 | Nov 9, 09:01 |
| payment-approval | deepseek-v4.1-flash-1017 | none | 102 | 18 | Done | 5 | $0.0223 | Nov 9, 09:02 |
| statement | deepseek-v4.1-flash-1017 | none | 124 | 16 | Done | 7 | $0.0308 | Nov 9, 09:03 |
| transfer-form | deepseek-v4.1-flash-1017 | none | 60 | 7 | Incomplete | 5 | $0.0124 | Nov 9, 09:05 |
| kyc-form | kimi-k3.1-pro | none | 293 | 28 | Done | 5 | $0.2979 | Nov 9, 09:25 |
| loan-contract | kimi-k3.1-pro | none | 360 | 59 | Done | 5 | $0.2373 | Nov 9, 09:27 |
| payment-approval | kimi-k3.1-pro | none | 297 | 45 | Done | 4 | $0.1808 | Nov 9, 09:29 |
| statement | kimi-k3.1-pro | none | 227 | 28 | Done | 4 | $0.1185 | Nov 9, 09:31 |
| transfer-form | nemotron-3.5-lightning-free | none | 0 | 21 | Incomplete | 4 | $0.0000 | Nov 10, 02:02 |
| transfer-form | beam-free | none | 0 | 0 | Incomplete | 11 | $0.0000 | Nov 10, 02:06 |
| account-details | beam-free | none | 52 | 13 | Incomplete | 16 | $0.0000 | Nov 10, 02:15 |
| account-details | nemotron-3.5-lightning-free | none | 4 | 27 | Done | 4 | $0.0000 | Nov 10, 02:15 |
| card-dispute | nemotron-3.5-lightning-free | none | 0 | 4 | Incomplete | 4 | $0.0000 | Nov 10, 02:15 |
| direct-debits | nemotron-3.5-lightning-free | none | 4 | 6 | Incomplete | 3 | $0.0000 | Nov 10, 02:15 |
| card-dispute | beam-free | none | 24 | 18 | Done | 10 | $0.0000 | Nov 10, 02:15 |
| kyc-form | nemotron-3.5-lightning-free | none | 0 | 88 | Incomplete | 3 | $0.0000 | Nov 10, 02:15 |
| direct-debits | beam-free | none | 87 | 17 | Done | 11 | $0.0000 | Nov 10, 02:16 |
| loan-contract | nemotron-3.5-lightning-free | none | 3 | 28 | Incomplete | 3 | $0.0000 | Nov 10, 02:16 |
| notification-settings | nemotron-3.5-lightning-free | none | 25 | 21 | Incomplete | 3 | $0.0000 | Nov 10, 02:16 |
| kyc-form | beam-free | none | 48 | 10 | Done | 11 | $0.0000 | Nov 10, 02:16 |
| payment-approval | nemotron-3.5-lightning-free | none | 21 | 11 | Done | 3 | $0.0000 | Nov 10, 02:16 |
| statement | nemotron-3.5-lightning-free | none | 18 | 8 | Done | 4 | $0.0000 | Nov 10, 02:17 |
| transactions | nemotron-3.5-lightning-free | none | 28 | 6 | Done | 4 | $0.0000 | Nov 10, 02:17 |
| loan-contract | beam-free | none | 36 | 20 | Done | 12 | $0.0000 | Nov 10, 02:17 |
| transfer-form | nemotron-3.5-lightning-free | none | 3 | 19 | Incomplete | 4 | $0.0000 | Nov 10, 02:18 |