Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all agents

Claude Opus 4.7 → OpenSCAD

B · Engineering-Aided
composite 51.6 [42.2, 59.7]p5 0.0IRT θ 8.4
Anthropic + OpenSCAD 2024.06· vopus-4.7 + openscad 2024.06· released 2026-01-22· LLM+OpenSCAD· emits OpenSCAD· proprietary· 1000k ctx· $0.015/$0.075 per 1k tok

Same prompt template as the Gemini pipeline. Output is mesh-only.

L1 GeomL2 EngL3 MfgL4 Cogvs. human
solid: agent · dashed: human baseline

PER-CATEGORY SCORE (95 % CI)

Geometric Primitives
0.0
Boolean Robustness
87.9
BREP Fidelity
34.6
Free-form Surfaces
84.2
Parametric Mechanical Parts
38.9
Assembly & Mating
43.9
Standards Compliance
51.6
Sheet-Metal Bodies
60.0
Sealing-Groove Design
63.8
Kinematic Mechanisms
56.9
DFM · 3-Axis CNC
63.2
DFM · Injection Mould
54.4
DFM · FDM 3D Print
71.3
CAM Toolpath Validity
52.5
Constraint Solving & Editability
29.3
Reverse Engineering
58.0
2-D Sketch Constraints
76.4
Functional Intent · FEA-Gated
51.5
Paraphrase Robustness
77.3
Confidence Calibration
39.5

MEAN METRICS BY LAYER

L1 · Geometry
CategoryVol IoUChamferHausdorffNormConsWatert.Manif.EulerSTEP RTP@1
Geometric Primitives0.0000.000
Boolean Robustness0.5770.938
BREP Fidelity0.862
Free-form Surfaces0.2161.0390.758
L2 · Engineering
CategoryDim RMSEGD&TFeatRecMatingFit-ClsStd
Parametric Mechanical Parts0.2590.4520.556
Assembly & Mating0.5950.4800.242
Standards Compliance0.4540.578
Sheet-Metal Bodies0.2890.575
Sealing-Groove Design0.2590.534
Kinematic Mechanisms0.5450.546
L3 · Manufacturing
CategoryDFMDraftMin-WallCAM-ReachSuppWall-Unif
DFM · 3-Axis CNC76.8000.5990.529
DFM · Injection Mould0.5420.5360.554
DFM · FDM 3D Print78.7000.5420.377
CAM Toolpath Validity0.487
L4 · Cognition
CategoryParamEditConSolveP-RangeFEA-σPara σSeed σBrierEditLat
Constraint Solving & Editability0.5880.6290.542
Reverse Engineering
2-D Sketch Constraints0.606
Functional Intent · FEA-Gated0.397
Paraphrase Robustness0.0460.045
Confidence Calibration0.105

TASK-BY-TASK ARTIFACTS

PRIM-001Hollow cylinder (60 × 40 × 100)0.0000.00PRIM-007Right hexagonal prism with pitch fillet0.0000.00BOOL-003Coplanar-face union (knife-edge stress)0.5430.00BOOL-009High-genus subtraction (lattice block)0.6110.00BREP-004NURBS-handle goblet (G2 swept loft)0.0750.00SURF-002Compressor blade (NACA 65-(12)10)0.3540.00MECH-014L-bracket with M6 + slotted hole0.4890.00MECH-022Stepped shaft with retaining-ring groove0.0000.00MECH-027Planetary-gear carrier plate0.5150.00ASM-005Pin-in-hole, H7/g6 sliding fit0.4210.00ASM-011Dovetail slide (60° flanks)0.4610.00STD-002ISO 4762 M8×30 socket-head cap screw0.4990.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.3740.00SEAL-001AS568-214 face-seal groove0.4130.00KIN-002Four-bar linkage, Grashof crank-rocker0.3950.00DFMCNC-0023-ax-machinable manifold block0.3830.00DFMMOLD-002Injection-mouldable enclosure half0.3540.00DFMFDM-008FDM-printable hinge (no support)0.4600.00CAM-0015-pocket plate, Ø3 endmill finish0.4860.00PARAM-006Editable flange (bolt circle param sweep)0.5550.00PARAM-013Editable bracket (length+30 %, hole→M8)0.0000.00REVENG-002Three-view ortho → bracket0.4150.00REVENG-009Three-view ortho → housing with cores0.3140.00SKETCH-003Tangent-arc transition profile0.5410.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.1740.00FUNC-007Heat-sink fin array for 25 W TO-2200.1760.00PARA-0015× paraphrased L-bracket0.5550.00CAL-003Confidence-calibrated planetary carrier0.3660.00