Metraipolis › archive › dc_e96df5533787

Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings — arXiv:2611.02659

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.02659
License (as archived)
CC0-1.0
Archived
2026-11-03T10:53:39.258Z
SHA-256 of the archived text
597e7df47bdaef8bace1545c6958a63b7d5647f3c7b6672cc1c3e1aab8d16a1b
Stable URL of this page
https://metraipolis.com/documento/dc_e96df5533787

How to cite

Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings — arXiv:2611.02659 — arXiv (en), https://arxiv.org/abs/2611.02659 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e96df5533787 (Metraipolis archive dc_e96df5533787, sha256 597e7df47bdaef8bace1545c6958a63b7d5647f3c7b6672cc1c3e1aab8d16a1b)
BibTeX
@misc{dce96df5533787,
  title = {Parametric CAD Bench v3: Evaluating Agentic Parametric CAD Authoring from Text and Engineering Drawings — arXiv:2611.02659},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.02659},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e96df5533787; sha256 597e7df47bdaef8bace1545c6958a63b7d5647f3c7b6672cc1c3e1aab8d16a1b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02659. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Producing an executable CAD script is not sufficient to establish that an agent has satisfied an engineering design request. Evaluation must also consider the resulting geometry, specified dimensions, and native CAD modeling history. We present Parametric CAD Bench v3, a 100-task benchmark comprising 30 text-to-CAD creation tasks, 30 text-to-CAD create-and-edit tasks, and 40 tasks that reconstruct mechanical parts from engineering drawings. Agents operate in a pinned FreeCAD environment and submit native CAD artifacts to a separate programmatic verifier. The primary metric is mean continuous task reward, combining geometry similarity and specification consistency rather than binary task success. A September 24, 2026 snapshot covers 13 model-agent systems; Claude Code with Claude Opus 5.5 achieves the highest overall point estimate, 61.03%, and an image-to-CAD mean reward of 84.66%. These measurements describe complete systems, not isolated model capabilities. We release versioned tasks, evaluation configurations, and inspectable result artifacts.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.02659 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:49:38.373Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).