BREP Fidelity
Tests whether the agent emits a clean boundary representation (named faces, coherent edge graph, exact NURBS surfaces) versus a tessellated approximation. Round-trips through AP242 STEP.
STEP Round-trip Chamfer · mm · ↓Edge-Manifoldness · ratio · ↑Euler-Poincaré Compliance · boolean · ↑Feature Recall · ratio · ↑
RANKED AGENTS · 95 % CI
| # | Agent | Score |
|---|---|---|
| 1 | Human Baseline (Mech-E) | 94.2 [94.2, 94.2] · n=1 |
| 2 | Claude Opus 4.7 → CadQuery | 90.7 [90.7, 90.7] · n=1 |
| 3 | Zoo Text-to-CAD | 90.4 [90.4, 90.4] · n=1 |
| 4 | Adam (CADcrush) | 89.3 [89.3, 89.3] · n=1 |
| 5 | DeepCAD | 82.5 [82.5, 82.5] · n=1 |
| 6 | GPT-5 → CadQuery | 62.6 [62.6, 62.6] · n=1 |
| 7 | Claude Opus 4.7 → OpenSCAD | 34.6 [34.6, 34.6] · n=1 |
| 8 | Gemini 2.5 Pro → OpenSCAD | 33.3 [33.3, 33.3] · n=1 |
| 9 | Trellis 3D | 26.3 [26.3, 26.3] · n=1 |
| 10 | Spline AI | 23.7 [23.7, 23.7] · n=1 |