nvidia/nemotron-3.5-lightning-free · genui-spec · all runs of loan-contract · Nov 10, 14:31
Runs from different design-system versions should not be compared.
A screenshot in each theme, as the benchmark took it.
As the agent left it; marked lines broke a rule.
import { GeneratedView } from "@vektos/genui";import data from "./fixture.json";import spec from "./spec.json";None. The run followed every rule that was checked.
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | submit_view submit_view: These parts of your view could not be shown. Send the whole view again with them fixed: - $.children[0]: This is JSON written as text, and it does not parse (JSON Parse error: Property name must be a string literal). Send each node as an object, not as a string. - $: A page needs one Heading of level 1, its title, before any other heading. | 489 | 5,553 | $0.0000 |
| 1 | submit_view submit_view: The view is accepted. Stop here. | 2,010 |
As the agent left it; marked lines broke a rule.
{ "type": "Stack", "props": { "direction": "column", "gap": "4" }, "children": [ { "type": "Heading", "props": { "level": 1, "text": "Personal Loan Contract Details" }, "children": [] }, { "type": "DataList", "props": { "orientation": "vertical", "items": [ { "label": "Product", "value": { "$data": "/contract/product" } }, { "label": "Contract number", "value": { "$data": "/contract/number" } }, { "label": "Status", "value": { "$data": "/contract/status" } } ] }, "children": [] }, { "type": "DataList", "props": { "orientation": "vertical", "items": [ { "label": "Amount borrowed", "value": { "$data": "/contract/principal" } }, { "label": "Nominal interest rate", "value": { "$data": "/contract/nominalRate" } }, { "label": "APR", "value": { "$data": "/contract/apr" } }, { "label": "Term (months)", "value": { "$data": "/contract/termMonths" } }, { "label": "Monthly payment", "value": { "$data": "/contract/monthlyPayment" } }, { "label": "Start date", "value": { "$data": "/contract/startDate" } }, { "label": "Outstanding", "value": { "$data": "/contract/outstanding" } } ] }, "children": [] }, { "type": "Card", "props": { "title": "Repayment Schedule", "accent": false }, "children": [ { "type": "Table", "props": { "caption": "Repayment schedule", "currency": "EUR", "columns": [ { "key": "dueDate", "label": "Due date", "format": "date" }, { "key": "payment", "label": "Payment", "format": "currency", "currency": "EUR" }, { "key": "principal", "label": "Principal", "format": "currency", "currency": "EUR" }, { "key": "interest", "label": "Interest", "format": "currency", "currency": "EUR" }, { "key": "remaining", "label": "Balance", "format": "currency", "currency": "EUR" }, { "key": "status", "label": "Status", "format": "text" } ], "rows": { "$data": "/schedule" } }, "children": [] } ] }, { "type": "Card", "props": { "title": "Signed Documents", "accent": false }, "children": [ { "type": "Table", "props": { "caption": "Signed documents", "columns": [ { "key": "name", "label": "Document", "format": "text" }, { "key": "signedAt", "label": "Signed date", "format": "date" } ], "rows": { "$data": "/documents" } }, "children": [] } ] } ]}| 2,277 |
| $0.0000 |