Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all agents

Zoo Text-to-CAD

A · Engineering-Capable
composite 71.6 [66.0, 76.1]p5 39.4IRT θ 89.7
Zoo (KittyCAD)· v2.4· released 2026-02-12· API· emits BREP· proprietary

Native BREP generator. Outputs valid AP242 STEP. Trained on the Zoo internal corpus + filtered GrabCAD. Endpoint: text-to-cad.zoo.dev/api.

L1 GeomL2 EngL3 MfgL4 Cogvs. human
solid: agent · dashed: human baseline

PER-CATEGORY SCORE (95 % CI)

Geometric Primitives
93.3
Boolean Robustness
44.0
BREP Fidelity
90.4
Free-form Surfaces
87.2
Parametric Mechanical Parts
73.6
Assembly & Mating
68.9
Standards Compliance
69.7
Sheet-Metal Bodies
76.5
Sealing-Groove Design
76.8
Kinematic Mechanisms
69.2
DFM · 3-Axis CNC
71.6
DFM · Injection Mould
71.5
DFM · FDM 3D Print
74.6
CAM Toolpath Validity
72.3
Constraint Solving & Editability
69.0
Reverse Engineering
64.9
2-D Sketch Constraints
83.8
Functional Intent · FEA-Gated
64.2
Paraphrase Robustness
85.8
Confidence Calibration
39.4

MEAN METRICS BY LAYER

L1 · Geometry
CategoryVol IoUChamferHausdorffNormConsWatert.Manif.EulerSTEP RTP@1
Geometric Primitives0.8250.1190.968
Boolean Robustness0.2920.469
BREP Fidelity0.9630.097
Free-form Surfaces0.1730.8540.806
L2 · Engineering
CategoryDim RMSEGD&TFeatRecMatingFit-ClsStd
Parametric Mechanical Parts0.1710.6580.721
Assembly & Mating0.7520.7460.569
Standards Compliance0.6420.752
Sheet-Metal Bodies0.1410.730
Sealing-Groove Design0.1590.696
Kinematic Mechanisms0.7700.649
L3 · Manufacturing
CategoryDFMDraftMin-WallCAM-ReachSuppWall-Unif
DFM · 3-Axis CNC81.8000.6230.706
DFM · Injection Mould0.7080.7080.730
DFM · FDM 3D Print78.3000.6820.455
CAM Toolpath Validity0.737
L4 · Cognition
CategoryParamEditConSolveP-RangeFEA-σPara σSeed σBrierEditLat
Constraint Solving & Editability0.6960.7340.641
Reverse Engineering
2-D Sketch Constraints0.740
Functional Intent · FEA-Gated0.482
Paraphrase Robustness0.0350.022
Confidence Calibration0.106

TASK-BY-TASK ARTIFACTS

PRIM-001Hollow cylinder (60 × 40 × 100)0.8340.00PRIM-007Right hexagonal prism with pitch fillet0.8150.00BOOL-003Coplanar-face union (knife-edge stress)0.5850.00BOOL-009High-genus subtraction (lattice block)0.0000.00BREP-004NURBS-handle goblet (G2 swept loft)0.7601.00SURF-002Compressor blade (NACA 65-(12)10)0.4550.00MECH-014L-bracket with M6 + slotted hole0.6360.00MECH-022Stepped shaft with retaining-ring groove0.5720.00MECH-027Planetary-gear carrier plate0.5130.00ASM-005Pin-in-hole, H7/g6 sliding fit0.6390.00ASM-011Dovetail slide (60° flanks)0.6370.00STD-002ISO 4762 M8×30 socket-head cap screw0.5500.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.5720.00SEAL-001AS568-214 face-seal groove0.5930.00KIN-002Four-bar linkage, Grashof crank-rocker0.5690.00DFMCNC-0023-ax-machinable manifold block0.5940.00DFMMOLD-002Injection-mouldable enclosure half0.6410.00DFMFDM-008FDM-printable hinge (no support)0.5010.00CAM-0015-pocket plate, Ø3 endmill finish0.7230.00PARAM-006Editable flange (bolt circle param sweep)0.5590.00PARAM-013Editable bracket (length+30 %, hole→M8)0.5440.00REVENG-002Three-view ortho → bracket0.3920.00REVENG-009Three-view ortho → housing with cores0.3770.00SKETCH-003Tangent-arc transition profile0.7150.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.4670.00FUNC-007Heat-sink fin array for 25 W TO-2200.4810.00PARA-0015× paraphrased L-bracket0.7310.00CAL-003Confidence-calibrated planetary carrier0.3210.00