DFMFDM-011 · DFM · FDM 3D Print · difficulty 4/5

Print-in-place hinge

sha256:33ce01bd02ef0a91…

§1Prompt verbatim

Two-leaf hinge that prints in one piece without supports: each leaf 40 × 30 × 3 mm, knuckle Ø 6 mm with a Ø 4 mm pin captive in a 0.3 mm clearance bore. Clearance must allow free 90° rotation post-print on a 0.4 mm nozzle FDM machine.

§2Ground-truth spec

shells2

watertighttrue

manifoldtrue

acceptance ε±0.1 mm

featurescaptive_pin, knuckle_x2

§3Reference render

canonical reference · drag to orbit, scroll to zoom

Visualisation is rebuilt in-browser from the canonical parametric description. Scoring is performed against the held-out reference STEP file (sha-256 fingerprint above).

§4Per-agent renders

reference + 10 agent outputs · scored against the held-out STEP

vol IoU · BREP · manifold

canonical reference

REFERENCE

canonical · ground truth

1.000100✓

Human Baseline (Mech-E)

n=4 senior engineers

0.75410✓

Claude Opus 4.7 → OpenSCAD

Anthropic + OpenSCAD 2024.06

OpenAI o4 (reasoning) → CadQuery

OpenAI + CadQuery 2.4

Claude Opus 4.7 → CadQuery

Anthropic + CadQuery 2.4

0.56813✗

GPT-5 → CadQuery

OpenAI + CadQuery 2.4

0.50910✗

Gemini 2.5 Pro → OpenSCAD

Google + OpenSCAD 2024.06

0.4720✗

DeepSeek R1 (reasoning) → CadQuery

DeepSeek + CadQuery 2.4

0.47011✗

GPT-5 Mini → OpenSCAD

OpenAI + OpenSCAD 2024.06

0.44212✗

Qwen3 Coder → CadQuery

Alibaba + CadQuery 2.4

0.44013✗

Gemini 2.5 Flash → CadQuery

Google + CadQuery 2.4

0.42116✗

CAD-Coder R1

CAD-Coder Labs (research)

0.38914✗

Claude Haiku 4.5 → CadQuery

Anthropic + CadQuery 2.4

Wu et al. 2021 (research)

no manifold solid produced

Claude Sonnet 4.6 → CadQuery

Anthropic + CadQuery 2.4

—66✗

no manifold solid produced

Llama 3.3 70B → OpenSCAD

Meta + OpenSCAD 2024.06

—14✗

Each tile is rebuilt from the canonical parametric description and degraded to match the agent's scored profile (tessellation, non-manifold face removal, dimension scale jitter, missing features). Image-only diffusion models render visually plausible meshes but score in the single digits on BREP fidelity — the geometry is not a manifold solid even when the render reads clean.

§5Per-agent metrics

ranked by Vol IoU · same data as the leaderboard, restricted to this task

Agent	Watert.	Manif.	DFM	Min-Wall Compliance	Support-Volume Ratio	P@1	p50	latency	cost
Human Baseline (Mech-E)	✓	0.967	90.1	0.823	0.303	1.000	—	906.5s	$4.896
Claude Opus 4.7 → OpenSCAD	✓	0.942	77.7	0.587	0.468	0.000	—	35.7s	$0.321
Adam (CADcrush)	✓	0.940	77.7	0.586	0.518	0.000	—	12.2s	$0.277
OpenAI o4 (reasoning) → CadQuery	✓	0.935	82.9	0.630	0.453	0.000	—	88.4s	$0.920
Zoo Text-to-CAD	✓	0.937	80.0	0.702	0.311	0.000	—	5.0s	$0.178
Claude Opus 4.7 → CadQuery	✓	0.930	81.4	0.626	0.373	0.000	—	32.1s	$0.339
GPT-5 → CadQuery	✓	0.927	78.9	0.634	0.288	0.000	—	35.6s	$0.217
Gemini 2.5 Pro → OpenSCAD	✓	0.916	77.1	0.497	0.453	0.000	—	21.4s	$0.084
DeepSeek R1 (reasoning) → CadQuery	✓	0.920	75.6	0.553	0.518	0.000	—	72.8s	$0.045
GPT-5 Mini → OpenSCAD	✓	0.921	74.5	0.464	0.407	0.000	—	17.9s	$0.012
Qwen3 Coder → CadQuery	×	0.912	70.3	0.530	0.434	0.000	—	12.8s	$0.032
Gemini 2.5 Flash → CadQuery	×	0.913	77.3	0.580	0.446	0.000	—	12.8s	$0.023
CAD-Coder R1	✓	0.914	71.1	0.514	0.460	0.000	—	7.5s	$0.005
Claude Haiku 4.5 → CadQuery	×	0.904	69.1	0.447	0.475	0.000	—	6.9s	$0.023
Hunyuan3D-2	×	0.893	68.5	0.210	0.456	0.000	—	40.0s	$0.062
Trellis 3D	×	0.880	65.8	0.201	0.653	0.000	—	9.8s	$0.057
DeepCAD	×	0.880	62.6	0.332	0.445	0.000	—	6.2s	$0.023
Spline AI	×	0.850	52.1	0.096	0.954	0.000	—	7.6s	$0.042
Claude Sonnet 4.6 → CadQuery kernel error: BRepCheck_NotClosed	×	0.000	—	—	—	0.000	—	18.1s	$0.073
Llama 3.3 70B → OpenSCAD kernel error: BRepCheck_NotClosed	×	0.000	—	—	—	0.000	—	24.6s	$0.017