nvidia/nemotron-3.5-lightning-free · genui-spec · all runs of transfer-form · Nov 10, 14:05
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[1].children[0].props.change: Too small: expected string to have >=1 characters - $.children[2].children[0].props.value: `value` must be one of the `options`. - $.children[2].children[1].props.hint: Too small: expected string to have >=1 characters - $.children[2].children[2].props.hint: Too small: expected string to have >=1 characters | 4,143 | 3,322 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "SEPA Transfer" } }, { "type": "Card", "props": { "title": "From account", "description": "Available balance", "accent": false }, "children": [ { "type": "Stat", "props": { "label": "Available", "value": 4821.37, "format": "currency", "currency": "EUR", "changeTone": "neutral", "description": "Balance of Current account" } } ] }, { "type": "Form", "props": { "submit": "Send transfer", "cancel": "Clear" }, "children": [ { "type": "SelectField", "props": { "label": "From account", "hint": "Select the account to pay from", "required": true, "options": [ "Current account", "Savings account", "Joint account" ], "value": "Current account", "placeholder": "Select account" } }, { "type": "TextField", "props": { "label": "Beneficiary name", "hint": "Beneficiary name", "required": true, "kind": "text", "placeholder": "e.g. John Doe" } }, { "type": "TextField", "props": { "label": "Beneficiary IBAN", "hint": "International Bank Account Number", "required": true, "kind": "text", "placeholder": "e.g. IT60 X054 2811 1010 0000 0123 456" } }, { "type": "TextField", "props": { "label": "Amount", "hint": "Available balance: EUR 4821.37", "required": true, "kind": "number", "placeholder": "0.00" } }, { "type": "TextField", "props": { "label": "Reference", "hint": "Optional", "required": false, "kind": "text", "placeholder": "Optional reference" } } ] }, { "type": "Alert", "props": { "title": "Success", "text": "Transfer of EUR 0.00 to beneficiary name completed.", "tone": "success" } } ]}| 7,608 |
| 1,078 |
| $0.0000 |