nvidia/nemotron-3.5-lightning-free · genui-spec · all runs of notification-settings · Nov 10, 13:30
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import spec from "./spec.json"; None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[0]: Expected a node: { type, props, children }. - $: A page needs one Heading of level 1, its title, before any other heading. | 1,960 | 3,398 | $0.0000 |
| 1 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[0]: Expected a node: { type, props, children }. - $: A page needs one Heading of level 1, its title, before any other heading. |
As the agent left it; marked lines broke a rule.
{ "type": "Form", "props": { "submit": "Save" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Notification settings" } }, { "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "DataList", "props": { "items": [ { "label": "Company", "value": "Ferri & Partners Srl" }, { "label": "Email", "value": "finance@ferripartners.example" } ], "orientation": "vertical" } }, { "type": "Heading", "props": { "level": 2, "text": "Alerts" } }, { "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Stack", "props": { "direction": "row", "gap": "4" }, "children": [ { "type": "Switch", "props": { "label": "Payment failed", "checked": true } }, { "type": "Text", "props": { "text": "When an outgoing payment is rejected by the recipient's bank.", "tone": "muted", "size": "sm" } } ] }, { "type": "Stack", "props": { "direction": "row", "gap": "4" }, "children": [ { "type": "Switch", "props": { "label": "Large transfer", "checked": true } }, { "type": "Text", "props": { "text": "When more than EUR 10,000 leaves the account in one transfer.", "tone": "muted", "size": "sm" } } ] }, { "type": "Stack", "props": { "direction": "row", "gap": "4" }, "children": [ { "type": "Switch", "props": { "label": "Card used abroad", "checked": false } }, { "type": "Text", "props": { "text": "When a company card is used outside Italy.", "tone": "muted", "size": "sm" } } ] } ] }, { "type": "Heading", "props": { "level": 2, "text": "Summary email" } }, { "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "SelectField", "props": { "label": "Frequency", "hint": "Choose how often to receive the summary email", "required": true, "options": [ "Daily", "Weekly", "Monthly", "Never" ], "value": "Weekly", "placeholder": "Select frequency" } }, { "type": "Checkbox", "props": { "label": "Send me product news", "hint": "Receive product news and updates", "required": false, "checked": false } } ] } ] } ]}| 5,490 |
| 784 |
| $0.0000 |
| 2 | submit_view submit_view: The view is accepted. Stop here. | 2,214 | 1,415 | $0.0000 |