Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all agents

Trellis 3D

C · Conceptual
composite 25.4 [18.1, 33.5]p5 0.0IRT θ 0.0
Microsoft Research· v1.0 (image-to-3D)· released 2024-12-15· Diffusion-3D· emits Mesh· open

Diffusion model over structured latents. Outputs a mesh only; STEP round-trip and BREP-fidelity tasks score 0 by definition.

L1 GeomL2 EngL3 MfgL4 Cogvs. human
solid: agent · dashed: human baseline

PER-CATEGORY SCORE (95 % CI)

Geometric Primitives
83.9
Boolean Robustness
23.7
BREP Fidelity
26.3
Free-form Surfaces
89.0
Parametric Mechanical Parts
25.5
Assembly & Mating
9.5
Standards Compliance
5.0
Sheet-Metal Bodies
26.7
Sealing-Groove Design
24.7
Kinematic Mechanisms
0.0
DFM · 3-Axis CNC
26.6
DFM · Injection Mould
14.6
DFM · FDM 3D Print
52.7
CAM Toolpath Validity
0.0
Constraint Solving & Editability
5.0
Reverse Engineering
41.0
2-D Sketch Constraints
12.6
Functional Intent · FEA-Gated
16.8
Paraphrase Robustness
65.8
Confidence Calibration
0.0

MEAN METRICS BY LAYER

L1 · Geometry
CategoryVol IoUChamferHausdorffNormConsWatert.Manif.EulerSTEP RTP@1
Geometric Primitives0.5100.1660.929
Boolean Robustness0.0850.863
BREP Fidelity0.852
Free-form Surfaces0.1400.8390.840
L2 · Engineering
CategoryDim RMSEGD&TFeatRecMatingFit-ClsStd
Parametric Mechanical Parts0.4970.0590.203
Assembly & Mating0.1900.0900.005
Standards Compliance0.0540.047
Sheet-Metal Bodies0.5440.218
Sealing-Groove Design0.5520.046
Kinematic Mechanisms
L3 · Manufacturing
CategoryDFMDraftMin-WallCAM-ReachSuppWall-Unif
DFM · 3-Axis CNC50.2000.2030.094
DFM · Injection Mould0.0880.2280.121
DFM · FDM 3D Print63.8000.2260.565
CAM Toolpath Validity
L4 · Cognition
CategoryParamEditConSolveP-RangeFEA-σPara σSeed σBrierEditLat
Constraint Solving & Editability0.0580.0570.036
Reverse Engineering
2-D Sketch Constraints0.057
Functional Intent · FEA-Gated0.085
Paraphrase Robustness0.0600.077
Confidence Calibration

TASK-BY-TASK ARTIFACTS

PRIM-001Hollow cylinder (60 × 40 × 100)0.5160.00PRIM-007Right hexagonal prism with pitch fillet0.5030.00BOOL-003Coplanar-face union (knife-edge stress)0.0490.00BOOL-009High-genus subtraction (lattice block)0.1210.00BREP-004NURBS-handle goblet (G2 swept loft)0.0150.00SURF-002Compressor blade (NACA 65-(12)10)0.5600.00MECH-014L-bracket with M6 + slotted hole0.0740.00MECH-022Stepped shaft with retaining-ring groove0.0290.00MECH-027Planetary-gear carrier plate0.0100.00ASM-005Pin-in-hole, H7/g6 sliding fit0.0000.00ASM-011Dovetail slide (60° flanks)0.0400.00STD-002ISO 4762 M8×30 socket-head cap screw0.0000.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.1940.00SEAL-001AS568-214 face-seal groove0.0000.00KIN-002Four-bar linkage, Grashof crank-rocker0.0000.00DFMCNC-0023-ax-machinable manifold block0.0040.00DFMMOLD-002Injection-mouldable enclosure half0.0530.00DFMFDM-008FDM-printable hinge (no support)0.2030.00CAM-0015-pocket plate, Ø3 endmill finish0.0000.00PARAM-006Editable flange (bolt circle param sweep)0.0000.00PARAM-013Editable bracket (length+30 %, hole→M8)0.0000.00REVENG-002Three-view ortho → bracket0.5500.00REVENG-009Three-view ortho → housing with cores0.5280.00SKETCH-003Tangent-arc transition profile0.0400.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.0000.00FUNC-007Heat-sink fin array for 25 W TO-2200.0000.00PARA-0015× paraphrased L-bracket0.5610.00CAL-003Confidence-calibrated planetary carrier0.0000.00