nvidia/nemotron-3.5-lightning-free · genui-spec · all runs of card-dispute · Nov 10, 13:25
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import spec from "./spec.json"; None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[1].props.description: Too small: expected string to have >=1 characters - $.children[3].children[0].props.hint: Too small: expected string to have >=1 characters - $.children[3].children[4].props.hint: Too small: expected string to have >=1 characters | 4,007 | 4,483 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. | 219 |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Dispute a payment" } }, { "type": "Card", "props": { "title": "Payment details", "description": "Payment details", "accent": false }, "children": [ { "type": "DataList", "props": { "items": [ { "label": "Merchant", "value": "Hotel Lago Blu Srl" }, { "label": "Date", "value": "2026-10-28" }, { "label": "Amount", "value": "EUR 342.80" }, { "label": "Card", "value": "Business card ending 4417" } ], "orientation": "vertical" } } ] }, { "type": "Text", "props": { "text": "A dispute must be opened within 120 days of the payment.", "tone": "muted", "size": "sm" } }, { "type": "Form", "props": { "submit": "Submit dispute", "cancel": "Cancel" }, "children": [ { "type": "SelectField", "props": { "label": "Reason", "hint": "Select a reason for your dispute", "required": true, "options": [ "I did not receive the goods or service", "I was charged twice", "The amount is wrong", "I do not recognise this payment" ], "value": "I did not receive the goods or service", "placeholder": "Select a reason" } }, { "type": "Text", "props": { "text": "Please select a reason.", "tone": "danger", "size": "xs" } }, { "type": "TextField", "props": { "label": "What happened", "hint": "Describe what happened", "required": true, "kind": "text", "value": "", "placeholder": "Enter description", "minLength": 30 } }, { "type": "Text", "props": { "text": "Description must be at least 30 characters.", "tone": "danger", "size": "xs" } }, { "type": "Checkbox", "props": { "label": "I contacted the merchant first and could not solve it", "hint": "I have contacted the merchant about this payment", "required": true, "checked": false } }, { "type": "Text", "props": { "text": "You must confirm you contacted the merchant.", "tone": "danger", "size": "xs" } } ] }, { "type": "Alert", "props": { "title": "Dispute open", "text": "Your dispute has been submitted. The bank will reply within 10 working days.", "tone": "success" } } ]}| 931 |
| $0.0000 |