Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all agents

Adam (CADcrush)

A · Engineering-Capable
composite 69.2 [65.5, 73.1]p5 56.1IRT θ 97.8
CADcrush· v1.1· released 2025-11-04· API· emits BREP· proprietary

Closed-beta natural-language modeller; emits parametric Onshape FeatureScript export. Tested through partner key (rate-limited 60 req/h).

L1 GeomL2 EngL3 MfgL4 Cogvs. human
solid: agent · dashed: human baseline

PER-CATEGORY SCORE (95 % CI)

Geometric Primitives
89.5
Boolean Robustness
75.3
BREP Fidelity
89.3
Free-form Surfaces
74.0
Parametric Mechanical Parts
72.9
Assembly & Mating
59.2
Standards Compliance
68.4
Sheet-Metal Bodies
70.8
Sealing-Groove Design
73.2
Kinematic Mechanisms
69.0
DFM · 3-Axis CNC
65.7
DFM · Injection Mould
61.0
DFM · FDM 3D Print
72.3
CAM Toolpath Validity
62.6
Constraint Solving & Editability
72.6
Reverse Engineering
60.3
2-D Sketch Constraints
81.2
Functional Intent · FEA-Gated
57.0
Paraphrase Robustness
83.5
Confidence Calibration
37.1

MEAN METRICS BY LAYER

L1 · Geometry
CategoryVol IoUChamferHausdorffNormConsWatert.Manif.EulerSTEP RTP@1
Geometric Primitives0.7010.1470.954
Boolean Robustness0.5760.934
BREP Fidelity0.9440.124
Free-form Surfaces0.4322.0570.682
L2 · Engineering
CategoryDim RMSEGD&TFeatRecMatingFit-ClsStd
Parametric Mechanical Parts0.1990.6630.723
Assembly & Mating0.6940.6290.454
Standards Compliance0.6470.721
Sheet-Metal Bodies0.2080.655
Sealing-Groove Design0.1710.634
Kinematic Mechanisms0.7340.634
L3 · Manufacturing
CategoryDFMDraftMin-WallCAM-ReachSuppWall-Unif
DFM · 3-Axis CNC79.7000.5790.596
DFM · Injection Mould0.5660.5800.685
DFM · FDM 3D Print74.7000.6410.437
CAM Toolpath Validity0.613
L4 · Cognition
CategoryParamEditConSolveP-RangeFEA-σPara σSeed σBrierEditLat
Constraint Solving & Editability0.7440.7100.724
Reverse Engineering
2-D Sketch Constraints0.692
Functional Intent · FEA-Gated0.404
Paraphrase Robustness0.0430.023
Confidence Calibration0.129

TASK-BY-TASK ARTIFACTS

PRIM-001Hollow cylinder (60 × 40 × 100)0.7750.00PRIM-007Right hexagonal prism with pitch fillet0.6270.00BOOL-003Coplanar-face union (knife-edge stress)0.6660.00BOOL-009High-genus subtraction (lattice block)0.4860.00BREP-004NURBS-handle goblet (G2 swept loft)0.6010.00SURF-002Compressor blade (NACA 65-(12)10)0.1750.00MECH-014L-bracket with M6 + slotted hole0.5580.00MECH-022Stepped shaft with retaining-ring groove0.6030.00MECH-027Planetary-gear carrier plate0.5520.00ASM-005Pin-in-hole, H7/g6 sliding fit0.5500.00ASM-011Dovetail slide (60° flanks)0.5250.00STD-002ISO 4762 M8×30 socket-head cap screw0.6490.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.5890.00SEAL-001AS568-214 face-seal groove0.5390.00KIN-002Four-bar linkage, Grashof crank-rocker0.4980.00DFMCNC-0023-ax-machinable manifold block0.5590.00DFMMOLD-002Injection-mouldable enclosure half0.5360.00DFMFDM-008FDM-printable hinge (no support)0.6120.00CAM-0015-pocket plate, Ø3 endmill finish0.6300.00PARAM-006Editable flange (bolt circle param sweep)0.8441.00PARAM-013Editable bracket (length+30 %, hole→M8)0.5740.00REVENG-002Three-view ortho → bracket0.3160.00REVENG-009Three-view ortho → housing with cores0.2820.00SKETCH-003Tangent-arc transition profile0.7340.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.3480.00FUNC-007Heat-sink fin array for 25 W TO-2200.3400.00PARA-0015× paraphrased L-bracket0.5720.00CAL-003Confidence-calibrated planetary carrier0.3820.00