Runs / stock-levels Batch Runs from different design-system versions should not be compared.
The page A screenshot in each theme, as the benchmark took it.
page.tsx As the agent left it; marked lines broke a rule.
Violations 2 counted, under 1 rule. “Not counted” marks a compiler error that restates a design-system violation, “Ignored” one the agent silenced with a comment.
Steps One row per model call, with the tools it asked for. An agent that reads the guidelines before writing shows it here; what a checker or submit_view answered is under its call.
Step Tools Tokens in Tokens out Cost 0 list_files 164 30 $0.0000 1 read_file 80 35 $0.0000 2 get_guidelines, list_components 790 40 $0.0000 3
Output cap 20,000 tokens a step 2 import data from "./fixture.json";
3
4 export default function Page() {
5 const items = data.items;
6 const itemCount = items.length;
7 const reorderCount = items.filter((item) => item.onHand <= item.reorderPoint).length;
8
9 return (
10 <div className="vektos">
11 <Stack gap="6" margin={{ base: "4", md: "8" }}>
12 <Stack gap="1">
13 <Heading level={1}>{data.warehouse.name}</Heading>
14 <Text tone="muted" size="sm">
15 Last counted{" "}
16 <FormatDate value={data.warehouse.countedAt} dateStyle="medium" timeStyle="short" />
17 </Text>
18 </Stack>
19
20 <Grid gridTemplateColumns={{ base: "1fr", md: "repeat(2, 1fr)" }} gap="4">
21 <Card>
22 <CardBody>
23 <Stat label="Items in stock" value={<FormatNumber value={itemCount} />} />
24 </CardBody>
25 </Card>
26 <Card>
27 <CardBody>
28 <Stat label="Need reordering" value={<FormatNumber value={reorderCount} />} />
29 </CardBody>
30 </Card>
31 </Grid>
32
33 <Card>
34 <CardHeader>
35 <CardTitle>Stock items</CardTitle>
36 </CardHeader>
37 <Table aria-label="Warehouse stock">
38 <TableHead>
39 <TableRow>
40 <TableHeader>SKU</TableHeader>
41 <TableHeader>Name</TableHeader>
42 <TableHeader>Location</TableHeader>
43 <TableHeader numeric>On hand</TableHeader>
44 <TableHeader numeric>Reserved</TableHeader>
45 <TableHeader numeric>Available</TableHeader>
46 <TableHeader>Unit</TableHeader>
47 <TableHeader>Status</TableHeader>
48 </TableRow>
49 </TableHead>
50 <TableBody>
51 {items.map((item) => {
52 const available = item.onHand - item.reserved;
53 const needsReorder = item.onHand <= item.reorderPoint;
54 return (
55 <TableRow key={item.sku}>
56 <TableCell>
57 <Text as="span" mono size="sm">
58 {item.sku}
59 </Text>
60 </TableCell>
61 <TableCell>{item.name}</TableCell>
62 <TableCell>{item.location}</TableCell>
63 <TableCell numeric>
64 <FormatNumber value={item.onHand} />
65 </TableCell>
66 <TableCell numeric>
67 <FormatNumber value={item.reserved} />
68 </TableCell>
69 <TableCell numeric>
70 <FormatNumber value={available} />
71 </TableCell>
72 <TableCell>{item.unit}</TableCell>
73 <TableCell>
74 {needsReorder ? <Badge tone="warning">Reorder</Badge> : null}
75 </TableCell>
76 </TableRow>
77 );
78 })}
79 </TableBody>
80 </Table>
81 </Card>
82 </Stack>
83 </div>
84 );
85 }
get_component, get_component, get_component, get_component, get_component, get_component, get_component, get_component, get_component
4 list_files 8,526 44 $0.0000
5 list_tokens, read_file 72 69 $0.0000
6 list_files 1,081 66 $0.0000
7 write_file 137 3,168 $0.0000