nvidia/nemotron-3.5-lightning-free · genui-spec · all runs of kyc-form · Nov 10, 14:30
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[0]: This is JSON written as text, and it does not parse (JSON Parse error: Unable to parse JSON string). Send each node as an object, not as a string. - $: A page needs one Heading of level 1, its title, before any other heading. | 2,082 | 4,785 | $0.0000 |
| 1 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[2].children[0].children[1].props.value: Too small: expected string to have >=1 characters - $.children[2].children[0].children[1].props.value: `value` must be one of the `options`. - $.children[2].children[0].children[2].props.value: Too small: expected string to have >=1 characters - $.children[2].children[0].children[2].props.value: `value` must be one of the `options`. - $.children[2].children[0].children[4].props.value: Too small: expected string to have >=1 characters - $.children[2].children[0].children[4].props.value: `value` must be one of the `options`. - $.children[2].children[0].children[6].props.value: Too small: expected string to have >=1 characters - $.children[2].children[0].children[6].props.value: `value` must be the label of one of the `options`. |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Identity verification" } }, { "type": "Text", "props": { "text": "Giulia Rossi – giulia.rossi@example.com", "tone": "default", "size": "md" } }, { "type": "Card", "props": { "title": "Verification details", "accent": false }, "children": [ { "type": "Form", "props": { "submit": "Continue", "cancel": "Cancel" }, "children": [ { "type": "TextField", "props": { "label": "Date of birth", "hint": "YYYY‑MM‑DD", "required": true, "kind": "date", "value": "1990-01-01" } }, { "type": "SelectField", "props": { "label": "Nationality", "hint": "Select your nationality", "required": true, "options": [ "Austria", "Belgium", "Germany", "Spain", "France", "Ireland", "Italy", "Netherlands", "Portugal" ], "value": "Austria" } }, { "type": "SelectField", "props": { "label": "Country of residence", "hint": "Select your country of residence", "required": true, "options": [ "Austria", "Belgium", "Germany", "Spain", "France", "Ireland", "Italy", "Netherlands", "Portugal" ], "value": "Germany" } }, { "type": "TextField", "props": { "label": "Tax identification number", "required": true, "kind": "text", "value": "123456789" } }, { "type": "SelectField", "props": { "label": "Identity document type", "required": true, "options": [ "National identity card", "Passport", "Driving licence" ], "value": "National identity card" } }, { "type": "TextField", "props": { "label": "Document number", "required": true, "kind": "text", "value": "AB1234567" } }, { "type": "ChoiceField", "props": { "label": "Politically exposed person", "required": true, "options": [ { "label": "Yes" }, { "label": "No" } ], "value": "Yes" } } ] } ] }, { "type": "Alert", "props": { "title": "Under review", "text": "Your identity verification details are being reviewed.", "tone": "success" } } ]}| 7,016 |
| 1,680 |
| $0.0000 |
| 2 | submit_view submit_view: The view is accepted. Stop here. | 590 | 1,475 | $0.0000 |