CAD-Bench
← back

Claude Opus 4.7 → OpenSCAD

B · Engineering-Aided
composite 54.3 [48.8, 59.8]p5 0.0IRT θ 57.3
Anthropic + OpenSCAD 2024.06· vopus-4.7 + openscad 2024.06· released 2026-01-22· LLM+OpenSCAD· emits OpenSCAD· proprietary· 1000k ctx· $0.015/$0.075 per 1k tok

Same prompt template as the Gemini pipeline. Output is mesh-only.

L1 GeomL2 EngL3 MfgL4 Cogvs. human
solid: agent · dashed: human baseline

PER-CATEGORY SCORE (95 % CI)

Geometric Primitives
73.0
Boolean Robustness
70.9
BREP Fidelity
26.1
Free-form Surfaces
84.8
Parametric Mechanical Parts
51.2
Assembly & Mating
43.5
Standards Compliance
51.0
Sheet-Metal Bodies
62.0
Sealing-Groove Design
67.7
Kinematic Mechanisms
55.7
DFM · 3-Axis CNC
61.5
DFM · Injection Mould
53.7
DFM · FDM 3D Print
70.6
CAM Toolpath Validity
53.9
Constraint Solving & Editability
38.5
Reverse Engineering
55.4
2-D Sketch Constraints
76.8
Functional Intent · FEA-Gated
34.5
Paraphrase Robustness
81.9
Confidence Calibration
40.0

MEAN METRICS BY LAYER

L1 · Geometry
CategoryVol IoUChamferHausdorffNormConsWatert.Manif.EulerSTEP RTP@1
Geometric Primitives0.4690.1570.802
Boolean Robustness0.5090.926
BREP Fidelity0.641
Free-form Surfaces0.2141.0520.779
L2 · Engineering
CategoryDim RMSEGD&TFeatRecMatingFit-ClsStd
Parametric Mechanical Parts0.2460.4540.583
Assembly & Mating0.5670.4960.242
Standards Compliance0.4490.570
Sheet-Metal Bodies0.2580.548
Sealing-Groove Design0.2360.590
Kinematic Mechanisms0.5540.527
L3 · Manufacturing
CategoryDFMDraftMin-WallCAM-ReachSuppWall-Unif
DFM · 3-Axis CNC77.5750.5590.511
DFM · Injection Mould0.4780.5870.545
DFM · FDM 3D Print78.0670.5830.490
CAM Toolpath Validity0.519
L4 · Cognition
CategoryParamEditConSolveP-RangeFEA-σPara σSeed σBrierEditLat
Constraint Solving & Editability0.5940.5830.557
Reverse Engineering
2-D Sketch Constraints0.613
Functional Intent · FEA-Gated0.384
Paraphrase Robustness0.0300.042
Confidence Calibration0.100

TASK-BY-TASK ARTIFACTS

PRIM-001Hollow cylinder (60 × 40 × 100)0.5750.00PRIM-007Right hexagonal prism with pitch fillet0.4850.00BOOL-003Coplanar-face union (knife-edge stress)0.5840.00BOOL-009High-genus subtraction (lattice block)0.5060.00BREP-004NURBS-handle goblet (G2 swept loft)0.0900.00SURF-002Compressor blade (NACA 65-(12)10)0.3300.00MECH-014L-bracket with M6 + slotted hole0.5600.00MECH-022Stepped shaft with retaining-ring groove0.0000.00MECH-027Planetary-gear carrier plate0.5580.00ASM-005Pin-in-hole, H7/g6 sliding fit0.4200.00ASM-011Dovetail slide (60° flanks)0.4530.00STD-002ISO 4762 M8×30 socket-head cap screw0.4850.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.6840.00SEAL-001AS568-214 face-seal groove0.5450.00KIN-002Four-bar linkage, Grashof crank-rocker0.3890.00DFMCNC-0023-ax-machinable manifold block0.4460.00DFMMOLD-002Injection-mouldable enclosure half0.3570.00DFMFDM-008FDM-printable hinge (no support)0.6240.00CAM-0015-pocket plate, Ø3 endmill finish0.5210.00PARAM-006Editable flange (bolt circle param sweep)0.5440.00PARAM-013Editable bracket (length+30 %, hole→M8)0.0000.00REVENG-002Three-view ortho → bracket0.4110.00REVENG-009Three-view ortho → housing with cores0.4000.00SKETCH-003Tangent-arc transition profile0.5770.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.0000.00FUNC-007Heat-sink fin array for 25 W TO-2200.2440.00PARA-0015× paraphrased L-bracket0.6180.00CAL-003Confidence-calibrated planetary carrier0.3990.00PRIM-002Sphere with planar cap0.5370.00PRIM-003Right truncated cone (frustum)0.0000.00PRIM-004Square-base pyramid frustum0.5900.00PRIM-005Tilted-axis box (30°)0.5480.00PRIM-009Hollow torus (Ø100 mean × Ø8 tube, 1 mm wall)0.5500.00BOOL-001Tangent cylinder onto cube (line-of-contact)0.5190.00BOOL-002Two interpenetrating spheres (lens intersection)0.4930.00BOOL-005ε-offset extrusion (sliver-face stress)0.4430.00BREP-001Periodic-spline cylinder (closed in U)0.0190.00BREP-002G1-only loft (tangent discontinuity)0.0000.00BREP-007Trimmed sphere with hole through pole0.0000.00SURF-001Ergonomic mug handle (revolved spline)0.4430.00SURF-007Mouse top-shell (Class-A)0.4100.00MECH-002Bearing block — two 6204 deep-groove bearings0.4640.00MECH-005Cam-follower lever (eccentric pivot)0.4050.00MECH-018Heat-set insert boss array (4× M3)0.5380.00MECH-031Threaded cap with diamond knurl0.5550.00ASM-001Threaded coupling M16×1.5 (male+female pair)0.4500.00ASM-008Spline shaft + hub (DIN 5480 W25×1.25×18)0.4800.00ASM-013Bayonet quarter-turn mount0.3100.00STD-001ISO 7050 self-tapping screw ST4.2 × 160.4570.00STD-005ISO 8734 dowel pin Ø6 m6 × 300.4780.00STD-008ASME B18.6.3 button-head 1/4-20 × 5/80.4430.00SHEET-001Box-pan with corner relief cuts0.5480.00SHEET-0073-bend electronics chassis0.4710.00SEAL-004AS568-218 piston-type radial groove0.4100.00SEAL-007ISO 3601-2 quad-ring face groove0.4640.00KIN-005Geneva drive — 4 station0.3710.00KIN-008Planetary gearset full mesh (sun + 3 planets + ring)0.2660.00DFMCNC-0054-pocket plate, R 0.5 internal corners0.5880.00DFMCNC-009Long-aspect bracket (vise-fixturable)0.4660.00DFMCNC-0135-axis-only fish-mouth saddle0.4050.00DFMMOLD-005Telephone handset shell0.4060.00DFMFDM-002Bridge-test calibration cube0.5740.00DFMFDM-011Print-in-place hinge0.6330.00CAM-005T-slot pocket array (Ø 8 + Ø 4 endmills)0.4110.00PARAM-009Configurable bottle (height + cap params)0.3750.00REVENG-005ABC dataset stepped pulley (multi-view)0.3310.00SKETCH-014Symmetric four-bar profile0.5790.00FUNC-003Heat-sink for 60 W CoB LED0.3360.00PARA-0055× paraphrased planetary carrier0.7030.00CAL-007Confidence-bracketed mounting flange0.4770.00