Preprint · cad-bench/v0.5 · sweep 2026-04-12open · MIT
CAD·Benchv0.5
← all categories

CAM Toolpath Validity

Stricter cousin of DFM-CNC: an actual 3-axis CAM postprocessor (FreeCAD-Path) must generate a collision-free G-code program at a ≤0.05 mm finish stepover. Score = fraction of part surface produced.

CAM Reachability · ratio · Feature Recall · ratio ·

RANKED AGENTS · 95 % CI

#AgentScore
1Human Baseline (Mech-E)
89.6
[89.6, 89.6] · n=1
2Zoo Text-to-CAD
72.3
[72.3, 72.3] · n=1
3Claude Opus 4.7 → CadQuery
72.2
[72.2, 72.2] · n=1
4GPT-5 → CadQuery
68.3
[68.3, 68.3] · n=1
5Adam (CADcrush)
62.6
[62.6, 62.6] · n=1
6Claude Opus 4.7 → OpenSCAD
52.5
[52.5, 52.5] · n=1
7Gemini 2.5 Pro → OpenSCAD
49.8
[49.8, 49.8] · n=1
8Spline AI
6.8
[6.8, 6.8] · n=1
9DeepCAD
0.0
[0.0, 0.0] · n=1
10Trellis 3D
0.0
[0.0, 0.0] · n=1

TASKS IN THIS CATEGORY