DFMFDM-008 · DFM · FDM 3D Print · difficulty 3/5
FDM-printable hinge (no support)
sha256:44e92cd1aa7f3380…
§1Prompt verbatim
Living-hinge 80 × 30 × 6 mm with two 40 × 30 × 6 mm leaves and a 0.5 mm hinge web. All overhangs ≤ 45° from build plate, single body, FDM-printable without support material on a 0.4 mm nozzle.
§2Ground-truth spec
shells1
watertighttrue
manifoldtrue
acceptance ε±0.1 mm
featureshinge_web_0.5, no_overhang_gt45
§3Reference render
canonical reference · drag to orbit, scroll to zoom
Visualisation is rebuilt in-browser from the canonical parametric description. Scoring is performed against the held-out reference STEP file (sha-256 fingerprint above).
§4Per-agent renders
reference + 10 agent outputs · scored against the held-out STEP
vol IoU · BREP · manifold
canonical reference
REFERENCE
canonical · ground truth
1.000100✓
Human Baseline (Mech-E)
Human Baseline (Mech-E)
n=4 senior engineers
0.63411✗
Adam (CADcrush)
Adam (CADcrush)
CADcrush
0.61213✗
Claude Opus 4.7 → CadQuery
Claude Opus 4.7 → CadQuery
Anthropic + CadQuery 2.4
0.60711✗
GPT-5 → CadQuery
GPT-5 → CadQuery
OpenAI + CadQuery 2.4
0.57110✗
Gemini 2.5 Pro → OpenSCAD
Gemini 2.5 Pro → OpenSCAD
Google + OpenSCAD 2024.06
0.5170✗
Zoo Text-to-CAD
Zoo Text-to-CAD
Zoo (KittyCAD)
0.5019✗
Claude Opus 4.7 → OpenSCAD
Claude Opus 4.7 → OpenSCAD
Anthropic + OpenSCAD 2024.06
0.4600✗
Trellis 3D
Trellis 3D
Microsoft Research
0.2030✗
DeepCAD
DeepCAD
Wu et al. 2021 (research)
0.13833✗
Spline AI
Spline AI
Spline.design
0.1230✗
Each tile is rebuilt from the canonical parametric description and degraded to match the agent's scored profile (tessellation, non-manifold face removal, dimension scale jitter, missing features). Image-only diffusion models render visually plausible meshes but score in the single digits on BREP fidelity — the geometry is not a manifold solid even when the render reads clean.
§5Per-agent metrics
ranked by Vol IoU · same data as the leaderboard, restricted to this task
| Agent | Watert. | Manif. | DFM | Min-Wall Compliance | Support-Volume Ratio | P@1 | p50 | latency | cost |
|---|---|---|---|---|---|---|---|---|---|
| Human Baseline (Mech-E) | ✓ | 0.944 | 89.0 | 0.832 | 0.269 | 0.000 | — | 752.0s | $7.059 |
| Adam (CADcrush) | ✓ | 0.937 | 74.7 | 0.641 | 0.437 | 0.000 | — | 9.6s | $0.241 |
| Claude Opus 4.7 → CadQuery | ✓ | 0.943 | 81.5 | 0.643 | 0.376 | 0.000 | — | 30.3s | $0.321 |
| GPT-5 → CadQuery | ✓ | 0.939 | 79.5 | 0.658 | 0.295 | 0.000 | — | 33.7s | $0.195 |
| Gemini 2.5 Pro → OpenSCAD | ✓ | 0.931 | 78.1 | 0.504 | 0.294 | 0.000 | — | 22.1s | $0.075 |
| Zoo Text-to-CAD | ✓ | 0.929 | 78.3 | 0.682 | 0.455 | 0.000 | — | 6.3s | $0.216 |
| Claude Opus 4.7 → OpenSCAD | ✓ | 0.923 | 78.7 | 0.542 | 0.377 | 0.000 | — | 34.6s | $0.298 |
| Trellis 3D | × | 0.882 | 63.8 | 0.226 | 0.565 | 0.000 | — | 8.9s | $0.042 |
| DeepCAD | × | 0.871 | 59.5 | 0.330 | 0.813 | 0.000 | — | 4.7s | $0.024 |
| Spline AI | × | 0.870 | 51.6 | 0.099 | 0.957 | 0.000 | — | 8.2s | $0.041 |