CAD-Coder R1
B · Engineering-Aidedcomposite 60.3 [55.5, 65.0]p5 31.7IRT θ 64.3
CAD-Coder Labs (research)· vr1-cad-7b + cadquery 2.4· released 2026-01-04· LLM+CadQuery· emits CadQuery· research· 64k ctx· $0.0003/$0.0006 per 1k tok
Specialty model fine-tuned on a 1.2 M synthetic CadQuery corpus from the ABC dataset. Punches well above its weight on primitives and brep_fidelity at 7B params; falls off on functional_intent (no FEA training signal).
solid: agent · dashed: human baseline
PER-CATEGORY SCORE (95 % CI)
Geometric Primitives
90.9
Boolean Robustness
64.4
BREP Fidelity
88.2
Free-form Surfaces
76.3
Parametric Mechanical Parts
52.5
Assembly & Mating
48.1
Standards Compliance
46.8
Sheet-Metal Bodies
63.2
Sealing-Groove Design
61.6
Kinematic Mechanisms
59.1
DFM · 3-Axis CNC
60.0
DFM · Injection Mould
48.8
DFM · FDM 3D Print
68.1
CAM Toolpath Validity
58.4
Constraint Solving & Editability
57.6
Reverse Engineering
56.2
2-D Sketch Constraints
77.1
Functional Intent · FEA-Gated
48.5
Paraphrase Robustness
42.0
Confidence Calibration
33.1
MEAN METRICS BY LAYER
L1 · Geometry
| Category | Vol IoU | Chamfer | Hausdorff | NormCons | Watert. | Manif. | Euler | STEP RT | P@1 |
|---|---|---|---|---|---|---|---|---|---|
| Geometric Primitives | 0.740 | 0.128 | — | — | — | 0.960 | — | — | — |
| Boolean Robustness | 0.429 | — | — | — | — | 0.747 | — | — | — |
| BREP Fidelity | — | — | — | — | — | 0.939 | — | 0.100 | — |
| Free-form Surfaces | — | 0.388 | 1.889 | 0.709 | — | — | — | — | — |
L2 · Engineering
| Category | Dim RMSE | GD&T | FeatRec | Mating | Fit-Cls | Std |
|---|---|---|---|---|---|---|
| Parametric Mechanical Parts | 0.289 | 0.457 | 0.671 | — | — | — |
| Assembly & Mating | — | — | 0.676 | 0.518 | 0.249 | — |
| Standards Compliance | — | 0.439 | — | — | — | 0.497 |
| Sheet-Metal Bodies | 0.285 | — | 0.657 | — | — | — |
| Sealing-Groove Design | 0.276 | — | — | — | — | 0.509 |
| Kinematic Mechanisms | — | — | 0.631 | 0.528 | — | — |
L3 · Manufacturing
| Category | DFM | Draft | Min-Wall | CAM-Reach | Supp | Wall-Unif |
|---|---|---|---|---|---|---|
| DFM · 3-Axis CNC | 75.525 | — | 0.524 | 0.520 | — | — |
| DFM · Injection Mould | — | 0.450 | 0.497 | — | — | 0.518 |
| DFM · FDM 3D Print | 71.600 | — | 0.532 | — | 0.412 | — |
| CAM Toolpath Validity | — | — | — | 0.508 | — | — |
L4 · Cognition
| Category | ParamEdit | ConSolve | P-Range | FEA-σ | Para σ | Seed σ | Brier | EditLat |
|---|---|---|---|---|---|---|---|---|
| Constraint Solving & Editability | 0.607 | 0.584 | 0.537 | — | — | — | — | — |
| Reverse Engineering | — | — | — | — | — | — | — | — |
| 2-D Sketch Constraints | — | 0.608 | — | — | — | — | — | — |
| Functional Intent · FEA-Gated | — | — | — | 0.280 | — | — | — | — |
| Paraphrase Robustness | — | — | — | — | 0.040 | 0.024 | — | — |
| Confidence Calibration | — | — | — | — | — | — | 0.168 | — |
TASK-BY-TASK ARTIFACTS
PRIM-001Hollow cylinder (60 × 40 × 100)0.7770.00PRIM-007Right hexagonal prism with pitch fillet0.6910.00BOOL-003Coplanar-face union (knife-edge stress)0.0000.00BOOL-009High-genus subtraction (lattice block)0.5140.00BREP-004NURBS-handle goblet (G2 swept loft)0.5690.00SURF-002Compressor blade (NACA 65-(12)10)0.2210.00MECH-014L-bracket with M6 + slotted hole0.5010.00MECH-022Stepped shaft with retaining-ring groove0.4420.00MECH-027Planetary-gear carrier plate0.5400.00ASM-005Pin-in-hole, H7/g6 sliding fit0.4670.00ASM-011Dovetail slide (60° flanks)0.4870.00STD-002ISO 4762 M8×30 socket-head cap screw0.4720.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.6200.00SEAL-001AS568-214 face-seal groove0.4580.00KIN-002Four-bar linkage, Grashof crank-rocker0.3290.00DFMCNC-0023-ax-machinable manifold block0.4320.00DFMMOLD-002Injection-mouldable enclosure half0.3760.00DFMFDM-008FDM-printable hinge (no support)0.3900.00CAM-0015-pocket plate, Ø3 endmill finish0.4180.00PARAM-006Editable flange (bolt circle param sweep)0.5670.00PARAM-013Editable bracket (length+30 %, hole→M8)0.4290.00REVENG-002Three-view ortho → bracket0.3590.00REVENG-009Three-view ortho → housing with cores0.3390.00SKETCH-003Tangent-arc transition profile0.5310.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.1870.00FUNC-007Heat-sink fin array for 25 W TO-2200.1520.00PARA-0015× paraphrased L-bracket0.5200.00CAL-003Confidence-calibrated planetary carrier0.2990.00PRIM-002Sphere with planar cap0.8380.00PRIM-003Right truncated cone (frustum)0.6750.00PRIM-004Square-base pyramid frustum0.6710.00PRIM-005Tilted-axis box (30°)0.7950.00PRIM-009Hollow torus (Ø100 mean × Ø8 tube, 1 mm wall)0.7350.00BOOL-001Tangent cylinder onto cube (line-of-contact)0.5310.00BOOL-002Two interpenetrating spheres (lens intersection)0.6100.00BOOL-005ε-offset extrusion (sliver-face stress)0.4920.00BREP-001Periodic-spline cylinder (closed in U)0.6190.00BREP-002G1-only loft (tangent discontinuity)0.6780.00BREP-007Trimmed sphere with hole through pole0.5330.00SURF-001Ergonomic mug handle (revolved spline)0.3380.00SURF-007Mouse top-shell (Class-A)0.1360.00MECH-002Bearing block — two 6204 deep-groove bearings0.5590.00MECH-005Cam-follower lever (eccentric pivot)0.0000.00MECH-018Heat-set insert boss array (4× M3)0.6390.00MECH-031Threaded cap with diamond knurl0.6460.00ASM-001Threaded coupling M16×1.5 (male+female pair)0.3280.00ASM-008Spline shaft + hub (DIN 5480 W25×1.25×18)0.3820.00ASM-013Bayonet quarter-turn mount0.3960.00STD-001ISO 7050 self-tapping screw ST4.2 × 160.3710.00STD-005ISO 8734 dowel pin Ø6 m6 × 300.3910.00STD-008ASME B18.6.3 button-head 1/4-20 × 5/80.5890.00SHEET-001Box-pan with corner relief cuts0.6380.00SHEET-0073-bend electronics chassis0.4620.00SEAL-004AS568-218 piston-type radial groove0.4380.00SEAL-007ISO 3601-2 quad-ring face groove0.3080.00KIN-005Geneva drive — 4 station0.4120.00KIN-008Planetary gearset full mesh (sun + 3 planets + ring)0.3760.00DFMCNC-0054-pocket plate, R 0.5 internal corners0.3970.00DFMCNC-009Long-aspect bracket (vise-fixturable)0.4390.00DFMCNC-0135-axis-only fish-mouth saddle0.6140.00DFMMOLD-005Telephone handset shell0.3870.00DFMFDM-002Bridge-test calibration cube0.4940.00DFMFDM-011Print-in-place hinge0.3890.00CAM-005T-slot pocket array (Ø 8 + Ø 4 endmills)0.3500.00PARAM-009Configurable bottle (height + cap params)0.5150.00REVENG-005ABC dataset stepped pulley (multi-view)0.3460.00SKETCH-014Symmetric four-bar profile0.5990.00FUNC-003Heat-sink for 60 W CoB LED0.1040.00PARA-0055× paraphrased planetary carrier0.0000.00CAL-007Confidence-bracketed mounting flange0.2470.00