2-D Sketch Constraints
Closed planar profiles defined purely by geometric constraints (tangency, equal-length, perpendicular, coincident). Score is fraction of constraints the agent honors after sketch resolution.
Constraint Solve Rate · ratio · ↑Bidirectional Chamfer · mm · ↓
RANKED AGENTS · 95 % CI
| # | Agent | Score |
|---|---|---|
| 1 | Human Baseline (Mech-E) | 87.6 [87.6, 87.6] · n=1 |
| 2 | Claude Opus 4.7 → CadQuery | 84.8 [84.8, 84.8] · n=1 |
| 3 | GPT-5 → CadQuery | 83.8 [83.8, 83.8] · n=1 |
| 4 | Zoo Text-to-CAD | 83.8 [83.8, 83.8] · n=1 |
| 5 | Adam (CADcrush) | 81.2 [81.2, 81.2] · n=1 |
| 6 | Claude Opus 4.7 → OpenSCAD | 76.4 [76.4, 76.4] · n=1 |
| 7 | Gemini 2.5 Pro → OpenSCAD | 72.5 [72.5, 72.5] · n=1 |
| 8 | DeepCAD | 53.7 [53.7, 53.7] · n=1 |
| 9 | Trellis 3D | 12.6 [12.6, 12.6] · n=1 |
| 10 | Spline AI | 12.1 [12.1, 12.1] · n=1 |