reflection/beam-free · genui-spec · all runs of notification-settings · Nov 10, 14:28
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[2].children[0].children[0].type: Put each Switch inside a Form. - $.children[2].children[0].children[1].type: Put each Switch inside a Form. - $.children[2].children[0].children[2].type: Put each Switch inside a Form. - $.children[3].children[0].children[0].props.value: `value` must be one of the `options`. | 439 | 10,925 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Notification settings" } }, { "type": "Card", "props": { "title": "Notifications go to" }, "children": [ { "type": "DataList", "props": { "items": [ { "label": "Company name", "value": { "$data": "/account/name" } }, { "label": "Email address", "value": { "$data": "/account/email" } } ] } } ] }, { "type": "Card", "props": { "title": "Alerts" }, "children": [ { "type": "Form", "props": { "submit": "Save" }, "children": [ { "type": "Switch", "props": { "label": { "$data": "/alerts/0/label" }, "hint": { "$data": "/alerts/0/description" }, "checked": { "$data": "/alerts/0/enabled" } } }, { "type": "Switch", "props": { "label": { "$data": "/alerts/1/label" }, "hint": { "$data": "/alerts/1/description" }, "checked": { "$data": "/alerts/1/enabled" } } }, { "type": "Switch", "props": { "label": { "$data": "/alerts/2/label" }, "hint": { "$data": "/alerts/2/description" }, "checked": { "$data": "/alerts/2/enabled" } } } ] } ] }, { "type": "Card", "props": { "title": "Summary email" }, "children": [ { "type": "Form", "props": { "submit": "Save" }, "children": [ { "type": "SelectField", "props": { "label": "Frequency", "options": { "$data": "/summary/options", "pick": "value" }, "value": { "$data": "/summary/frequency" } } }, { "type": "Checkbox", "props": { "label": "Send me product news", "checked": { "$data": "/productNews" } } } ] } ] } ]}| 11,506 |
| 1,985 |
| $0.0000 |