Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all agents

DeepCAD

C · Conceptual
composite 42.1 [34.0, 50.3]p5 0.0IRT θ 13.6
Wu et al. 2021 (research)· vofficial checkpoint, retrained 2024-11· released 2024-11-30· Diffusion-3D· emits BREP· research

Transformer over CAD command sequences (extrude, revolve, sketch). Limited prompt vocabulary; we wrap with a Claude-3.5-mini paraphraser to convert natural prompts into the in-distribution token grammar.

L1 GeomL2 EngL3 MfgL4 Cogvs. human
solid: agent · dashed: human baseline

PER-CATEGORY SCORE (95 % CI)

Geometric Primitives
91.8
Boolean Robustness
45.3
BREP Fidelity
82.5
Free-form Surfaces
58.3
Parametric Mechanical Parts
33.9
Assembly & Mating
34.8
Standards Compliance
31.2
Sheet-Metal Bodies
52.6
Sealing-Groove Design
47.5
Kinematic Mechanisms
39.7
DFM · 3-Axis CNC
44.2
DFM · Injection Mould
36.5
DFM · FDM 3D Print
50.6
CAM Toolpath Validity
0.0
Constraint Solving & Editability
27.1
Reverse Engineering
41.0
2-D Sketch Constraints
53.7
Functional Intent · FEA-Gated
35.1
Paraphrase Robustness
68.3
Confidence Calibration
27.6

MEAN METRICS BY LAYER

L1 · Geometry
CategoryVol IoUChamferHausdorffNormConsWatert.Manif.EulerSTEP RTP@1
Geometric Primitives0.7700.1270.965
Boolean Robustness0.4060.907
BREP Fidelity0.9310.109
Free-form Surfaces0.8114.0650.643
L2 · Engineering
CategoryDim RMSEGD&TFeatRecMatingFit-ClsStd
Parametric Mechanical Parts0.3230.3690.480
Assembly & Mating0.4580.4130.173
Standards Compliance0.3620.262
Sheet-Metal Bodies0.2750.497
Sealing-Groove Design0.3420.292
Kinematic Mechanisms0.4440.449
L3 · Manufacturing
CategoryDFMDraftMin-WallCAM-ReachSuppWall-Unif
DFM · 3-Axis CNC64.6000.3380.343
DFM · Injection Mould0.3540.3400.400
DFM · FDM 3D Print59.5000.3300.813
CAM Toolpath Validity
L4 · Cognition
CategoryParamEditConSolveP-RangeFEA-σPara σSeed σBrierEditLat
Constraint Solving & Editability0.2810.3090.224
Reverse Engineering
2-D Sketch Constraints0.312
Functional Intent · FEA-Gated0.185
Paraphrase Robustness0.0820.045
Confidence Calibration0.224

TASK-BY-TASK ARTIFACTS

PRIM-001Hollow cylinder (60 × 40 × 100)0.7990.00PRIM-007Right hexagonal prism with pitch fillet0.7420.00BOOL-003Coplanar-face union (knife-edge stress)0.3680.00BOOL-009High-genus subtraction (lattice block)0.4440.00BREP-004NURBS-handle goblet (G2 swept loft)0.5240.00SURF-002Compressor blade (NACA 65-(12)10)0.1010.00MECH-014L-bracket with M6 + slotted hole0.4090.00MECH-022Stepped shaft with retaining-ring groove0.0000.00MECH-027Planetary-gear carrier plate0.4230.00ASM-005Pin-in-hole, H7/g6 sliding fit0.3390.00ASM-011Dovetail slide (60° flanks)0.3720.00STD-002ISO 4762 M8×30 socket-head cap screw0.1960.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.4340.00SEAL-001AS568-214 face-seal groove0.1070.00KIN-002Four-bar linkage, Grashof crank-rocker0.3300.00DFMCNC-0023-ax-machinable manifold block0.3560.00DFMMOLD-002Injection-mouldable enclosure half0.2380.00DFMFDM-008FDM-printable hinge (no support)0.1380.00CAM-0015-pocket plate, Ø3 endmill finish0.0000.00PARAM-006Editable flange (bolt circle param sweep)0.1540.00PARAM-013Editable bracket (length+30 %, hole→M8)0.1290.00REVENG-002Three-view ortho → bracket0.0920.00REVENG-009Three-view ortho → housing with cores0.0990.00SKETCH-003Tangent-arc transition profile0.1630.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.1620.00FUNC-007Heat-sink fin array for 25 W TO-2200.1070.00PARA-0015× paraphrased L-bracket0.4160.00CAL-003Confidence-calibrated planetary carrier0.1000.00