nvidia/nemotron-3.5-lightning-free · genui-spec-domain · all runs of stock-adjustment · Nov 10, 15:37
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[0]: This is JSON written as text, and it does not parse (JSON Parse error: Expected ':' before value in object property definition). Send each node as an object, not as a string. - $: A page needs one Heading of level 1, its title, before any other heading. | 743 | 3,008 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. | 1,808 |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Correct stock adjustment" } }, { "type": "Card", "props": { "title": "Item details", "accent": false }, "children": [ { "type": "Stack", "props": { "direction": "column", "gap": "2" }, "children": [ { "type": "Text", "props": { "text": "SKU: STR-23-500", "tone": "default", "size": "md" } }, { "type": "Text", "props": { "text": "Name: Stretch film 23 µm, 500 m", "tone": "default", "size": "md" } }, { "type": "Text", "props": { "text": "Location: C-04-01", "tone": "default", "size": "md" } }, { "type": "Stat", "props": { "label": "Current quantity", "value": 36, "format": "number", "changeTone": "neutral" } }, { "type": "Text", "props": { "text": "Unit: rolls", "tone": "default", "size": "md" } }, { "type": "Text", "props": { "text": "Difference: will be calculated as new quantity minus current quantity.", "tone": "muted", "size": "sm" } } ] } ] }, { "type": "Form", "props": { "submit": "Save adjustment", "cancel": "Cancel" }, "children": [ { "type": "TextField", "props": { "label": "New quantity", "hint": "Enter the counted quantity (whole number, not negative)", "required": true, "kind": "number" } }, { "type": "ChoiceField", "props": { "label": "Reason", "hint": "Select the reason for adjustment", "required": true, "options": [ { "label": "Count correction", "description": "The count found a different quantity." }, { "label": "Damaged", "description": "Goods that can no longer be sold." }, { "label": "Found", "description": "Goods found in another location." }, { "label": "Expired", "description": "Goods past their use-by date." } ] } }, { "type": "TextField", "props": { "label": "Comment", "hint": "Optional note", "required": false, "kind": "text", "placeholder": "Add a comment..." } } ] }, { "type": "Alert", "props": { "title": "Adjustment saved", "text": "New quantity: {{newQuantity}}", "tone": "success" } } ]}| 1,894 |
| $0.0000 |