Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all categories

Functional Intent · FEA-Gated

Prompts specify a *function* ("hold a 250 N transverse load with a 4× safety factor in 6061-T6") rather than a geometry. Score requires the agent's part to pass automatic linear-elastic FEA at the spec'd load with stress ≤ 0.8·σ_yield.

FEA-Yield Pass · ratio · Min-Wall Compliance · ratio · Feature Recall · ratio ·

RANKED AGENTS · 95 % CI

#AgentScore
1Human Baseline (Mech-E)
82.9
[82.8, 82.9] · n=2
2Zoo Text-to-CAD
64.2
[62.4, 65.9] · n=2
3Claude Opus 4.7 → CadQuery
62.6
[62.0, 63.2] · n=2
4GPT-5 → CadQuery
61.4
[60.3, 62.6] · n=2
5Adam (CADcrush)
57.0
[56.1, 57.8] · n=2
6Claude Opus 4.7 → OpenSCAD
51.5
[49.8, 53.1] · n=2
7Gemini 2.5 Pro → OpenSCAD
47.6
[46.1, 49.0] · n=2
8DeepCAD
35.1
[34.9, 35.4] · n=2
9Trellis 3D
16.8
[16.5, 17.0] · n=2
10Spline AI
8.0
[8.0, 8.1] · n=2

TASKS IN THIS CATEGORY