Designing from requirements, reconstructing a reference, creating a symbol and reviewing a circuit have different inputs, outputs and acceptance criteria. Evaluating each goal separately shows where the agent performs well and where it still needs improvement.
Schematic generation
Turn requirements into complete circuits. Focus: Functional completeness, component selection and module connections.
Circuit reconstruction
Interpret reference circuits accurately. Focus: Device parameters, polarity and net relationships.
Symbol creation
Convert device references into usable symbols. Focus: Pin completeness, numbers, names and package mappings.
Circuit diagnosis
Find and explain existing issues. Focus: Fault localization, causes and false positives on correct circuits.
Elapsed time and execution metrics for SchAI’s four task categories
Task category
Mean duration
Mean model calls
Cache hit rate
Mean input tokens
Mean output tokens
Schematic generation
828 s
25.3
94.1%
1,786,336
22,801
Circuit reconstruction
136 s
8.7
87.8%
197,053
3,792
Symbol creation
87 s
7.0
84.5%
197,342
2,440
Circuit diagnosis
27 s
4.3
88.8%
42,655
479
Loop rounds count model calls per task. Token counts are accumulated across calls; input tokens include cached input. Cache hit rate is the total cached input tokens divided by total input tokens.
Mean durations come from recorded runs. Results reflect project artifacts and checks, not physical hardware validation.