7 of 8 AI-generated 3D outputs failed DFM.
We turned the benchmark into a live browser CAD prototype: every edit is modeled server-side with OCCT/build123d, checked against 3-axis CNC rules, and painted back into the viewport before export.
Prototype
live DFM loopMakeable is a narrow proof: browser CAD with live manufacturability constraints. The modeler sends feature parameters to a FastAPI service, generates a real B-rep with build123d/OCCT, tessellates the same geometry the DFM engine checks, and returns mesh locations so violations can paint red/yellow in the viewport.
The first demo path is CNC-only: a pocket with sharp internal corners fails, increasing the cost readout through a tiny-tool penalty; rounding the pocket clears the DFM panel and drops the estimate before STEP export.
AI Output Findings
local geometry pass| Model | Task | Process | Verdict | Failed checks |
|---|---|---|---|---|
| shap-e-hf | 3d-mold-001 | molding | fail | draft, undercut |
| shap-e-hf | 3d-mold-002 | molding | fail | wall_thickness, draft, undercut |
| shap-e-hf | 3d-mold-003 | molding | fail | draft, undercut |
| shap-e-hf | 3d-mold-004 | molding | fail | draft, undercut |
| shap-e-hf | 3d-print-001 | fdm | fail | overhang |
| shap-e-hf | 3d-print-002 | fdm | pass | — |
| tripo-free | 3d-mold-001 | molding | fail | watertight, draft |
| tripo-free | 3d-print-001 | fdm | fail | watertight, overhang |
Only 10 local GLB outputs were available; 8 were usable for the current DFM run. The broader 111-output collection is mostly text/image tasks and needs separate scoring.