pick-list
7 design-system3 qualityDonenvidia/nemotron-3.5-lightning-free · none · all runs of pick-list · Nov 10, 15:00
Run
- Run
- 2c9584d1
- Cost
- $0.0000 (gateway $0.0000)
- Duration
- 10.2 s
- Steps
- 3 of 20 allowed, ended with stop
- Tokens
- 5,014 in (0 cached), 1,298 out
- Page
- Rendered
Batch
Runs from different design-system versions should not be compared.
- Label
- warehouse-free
- Commit
- ef30ec5
- Design system
- cdb5d9e77633
The page
A screenshot in each theme, as the benchmark took it.
page.tsx
As the agent left it; marked lines broke a rule.
"use client"; Violations
10 counted, under 4 rules. “Not counted” marks a compiler error that restates a design-system violation, “Ignored” one the agent silenced with a comment.
- page.tsx:18:17 · 800px`800px` is a raw length. Use a token.
- page.tsx:20:16 · 20px`20px` is a raw length. Use a token.
- page.tsx:36:53 · 12px`12px` is a raw length. Use a token.
- page.tsx:36:76 · 8px`8px` is a raw length. Use a token.
- page.tsx:37:61 · 4px`4px` is a raw length. Use a token.
- page.tsx:49:38 · 4px`4px` is a raw length. Use a token.
Steps
One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
| Step | Tools | Tokens in | Tokens out | Cost |
|---|---|---|---|---|
| 0 | read_file | 830 | 137 | $0.0000 |
| 1 | write_file | 1,532 | 1,093 | $0.0000 |
| 2 | stop | 2,652 | 68 | $0.0000 |