Geometric Primitives
Closed-form parametric primitives (boxes, cylinders, cones, tori, regular prisms) at exactly specified dimensions. Establishes a noise floor: agents that fail here cannot be trusted on harder tasks.
Volumetric IoU · ratio · ↑Bidirectional Chamfer · mm · ↓Watertightness · boolean · ↑Edge-Manifoldness · ratio · ↑
RANKED AGENTS · 95 % CI
| # | Agent | Score |
|---|---|---|
| 1 | Human Baseline (Mech-E) | 95.3 [93.7, 96.8] · n=2 |
| 2 | Zoo Text-to-CAD | 93.3 [93.2, 93.5] · n=2 |
| 3 | DeepCAD | 91.8 [90.8, 92.8] · n=2 |
| 4 | Claude Opus 4.7 → CadQuery | 89.7 [88.3, 91.1] · n=2 |
| 5 | Adam (CADcrush) | 89.5 [87.5, 91.5] · n=2 |
| 6 | GPT-5 → CadQuery | 87.5 [86.2, 88.7] · n=2 |
| 7 | Gemini 2.5 Pro → OpenSCAD | 84.2 [83.3, 85.0] · n=2 |
| 8 | Trellis 3D | 83.9 [83.8, 83.9] · n=2 |
| 9 | Claude Opus 4.7 → OpenSCAD | 0.0 [0.0, 0.0] · n=2 |
| 10 | Spline AI | 0.0 [0.0, 0.0] · n=2 |