Gemini 2.5 Pro → OpenSCAD
B · Engineering-Aidedcomposite 54.6 [49.9, 59.8]p5 33.3IRT θ 8.4
Google + OpenSCAD 2024.06· v2.5-pro + openscad 2024.06· released 2026-02-01· LLM+OpenSCAD· emits OpenSCAD· proprietary· 2000k ctx· $0.0035/$0.0105 per 1k tok
Mesh-only output (OpenSCAD does not produce BREP); STEP round-trip therefore disabled. CSG kernel: CGAL.
solid: agent · dashed: human baseline
PER-CATEGORY SCORE (95 % CI)
Geometric Primitives
84.2
Boolean Robustness
60.6
BREP Fidelity
33.3
Free-form Surfaces
82.6
Parametric Mechanical Parts
55.2
Assembly & Mating
39.9
Standards Compliance
47.9
Sheet-Metal Bodies
58.5
Sealing-Groove Design
62.0
Kinematic Mechanisms
51.8
DFM · 3-Axis CNC
57.5
DFM · Injection Mould
50.7
DFM · FDM 3D Print
71.3
CAM Toolpath Validity
49.8
Constraint Solving & Editability
55.1
Reverse Engineering
55.4
2-D Sketch Constraints
72.5
Functional Intent · FEA-Gated
47.6
Paraphrase Robustness
78.8
Confidence Calibration
34.9
MEAN METRICS BY LAYER
L1 · Geometry
| Category | Vol IoU | Chamfer | Hausdorff | NormCons | Watert. | Manif. | Euler | STEP RT | P@1 |
|---|---|---|---|---|---|---|---|---|---|
| Geometric Primitives | 0.519 | 0.167 | — | — | — | 0.931 | — | — | — |
| Boolean Robustness | 0.496 | — | — | — | — | 0.928 | — | — | — |
| BREP Fidelity | — | — | — | — | — | 0.850 | — | — | — |
| Free-form Surfaces | — | 0.227 | 1.296 | 0.748 | — | — | — | — | — |
L2 · Engineering
| Category | Dim RMSE | GD&T | FeatRec | Mating | Fit-Cls | Std |
|---|---|---|---|---|---|---|
| Parametric Mechanical Parts | 0.260 | 0.421 | 0.494 | — | — | — |
| Assembly & Mating | — | — | 0.528 | 0.458 | 0.213 | — |
| Standards Compliance | — | 0.452 | — | — | — | 0.505 |
| Sheet-Metal Bodies | 0.242 | — | 0.486 | — | — | — |
| Sealing-Groove Design | 0.255 | — | — | — | — | 0.494 |
| Kinematic Mechanisms | — | — | 0.487 | 0.453 | — | — |
L3 · Manufacturing
| Category | DFM | Draft | Min-Wall | CAM-Reach | Supp | Wall-Unif |
|---|---|---|---|---|---|---|
| DFM · 3-Axis CNC | 75.300 | — | 0.528 | 0.443 | — | — |
| DFM · Injection Mould | — | 0.479 | 0.558 | — | — | 0.484 |
| DFM · FDM 3D Print | 78.100 | — | 0.504 | — | 0.294 | — |
| CAM Toolpath Validity | — | — | — | 0.448 | — | — |
L4 · Cognition
| Category | ParamEdit | ConSolve | P-Range | FEA-σ | Para σ | Seed σ | Brier | EditLat |
|---|---|---|---|---|---|---|---|---|
| Constraint Solving & Editability | 0.559 | 0.586 | 0.508 | — | — | — | — | — |
| Reverse Engineering | — | — | — | — | — | — | — | — |
| 2-D Sketch Constraints | — | 0.528 | — | — | — | — | — | — |
| Functional Intent · FEA-Gated | — | — | — | 0.379 | — | — | — | — |
| Paraphrase Robustness | — | — | — | — | 0.036 | 0.049 | — | — |
| Confidence Calibration | — | — | — | — | — | — | 0.151 | — |
TASK-BY-TASK ARTIFACTS
PRIM-001Hollow cylinder (60 × 40 × 100)0.4990.00PRIM-007Right hexagonal prism with pitch fillet0.5390.00BOOL-003Coplanar-face union (knife-edge stress)0.6140.00BOOL-009High-genus subtraction (lattice block)0.3780.00BREP-004NURBS-handle goblet (G2 swept loft)0.0000.00SURF-002Compressor blade (NACA 65-(12)10)0.3390.00MECH-014L-bracket with M6 + slotted hole0.3080.00MECH-022Stepped shaft with retaining-ring groove0.3920.00MECH-027Planetary-gear carrier plate0.3390.00ASM-005Pin-in-hole, H7/g6 sliding fit0.3350.00ASM-011Dovetail slide (60° flanks)0.2790.00STD-002ISO 4762 M8×30 socket-head cap screw0.4150.00SHEET-003U-channel bracket, 1.5 mm Al, k=0.400.3590.00SEAL-001AS568-214 face-seal groove0.3600.00KIN-002Four-bar linkage, Grashof crank-rocker0.2740.00DFMCNC-0023-ax-machinable manifold block0.3000.00DFMMOLD-002Injection-mouldable enclosure half0.3790.00DFMFDM-008FDM-printable hinge (no support)0.5170.00CAM-0015-pocket plate, Ø3 endmill finish0.4160.00PARAM-006Editable flange (bolt circle param sweep)0.4970.00PARAM-013Editable bracket (length+30 %, hole→M8)0.4530.00REVENG-002Three-view ortho → bracket0.4030.00REVENG-009Three-view ortho → housing with cores0.4490.00SKETCH-003Tangent-arc transition profile0.7180.00FUNC-001Cantilever bracket — 250 N tip load, 6061-T6, SF≥40.1820.00FUNC-007Heat-sink fin array for 25 W TO-2200.1460.00PARA-0015× paraphrased L-bracket0.6730.00CAL-003Confidence-calibrated planetary carrier0.3080.00