Metraipolis › archive › dc_462a8ca5ecb5
Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings — arXiv:2611.02659
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.02659
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T10:43:57.353Z
- SHA-256 of the archived text
2359b2a8cdab0c28c241d32188efa1e49bc6f2f92f942778bba494c57dcbeaef- Stable URL of this page
https://metraipolis.com/documento/dc_462a8ca5ecb5
How to cite
Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings — arXiv:2611.02659 — arXiv (en), https://arxiv.org/abs/2611.02659 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_462a8ca5ecb5 (Metraipolis archive dc_462a8ca5ecb5, sha256 2359b2a8cdab0c28c241d32188efa1e49bc6f2f92f942778bba494c57dcbeaef)
BibTeX
@misc{dc462a8ca5ecb5,
title = {Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings — arXiv:2611.02659},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.02659},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_462a8ca5ecb5; sha256 2359b2a8cdab0c28c241d32188efa1e49bc6f2f92f942778bba494c57dcbeaef},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02659. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Producing an executable CAD script is not sufficient to establish that an agent has satisfied an engineering design request. Evaluation must also consider the resulting geometry, specified dimensions, and native CAD modeling history. We present Parametric CAD Bench v3, a 100-task benchmark comprising 30 text-to-CAD creation tasks, 30 text-to-CAD create-and-edit tasks, and 40 tasks that reconstruct mechanical parts from engineering drawings. Agents operate in a pinned FreeCAD environment and submit native CAD artifacts to a separate programmatic verifier. The primary metric is mean continuous task reward, combining geometry similarity and specification consistency rather than binary task success. A September 24, 2026 snapshot covers 13 model-agent systems; Claude Code with Claude Opus 5.5 achieves the highest overall point estimate, 61.03%, and an image-to-CAD mean reward of 84.66%. These measurements describe complete systems, not isolated model capabilities. We release versioned tasks, evaluation configurations, and inspectable result artifacts. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2611.02659 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T10:39:50.296Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).