Metraipolis › archive › dc_ca52f8e63e49
Towards Standardized Evaluation in Automated Domain Modeling: Introducing a Benchmark — arXiv:2608.15255
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.15255
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T17:13:32.713Z
- SHA-256 of the archived text
046482d8ba4ad8cc1357511f00f0babdf97d1bbf5101f0463ced32046317dd91- Stable URL of this page
https://metraipolis.com/documento/dc_ca52f8e63e49
How to cite
Towards Standardized Evaluation in Automated Domain Modeling: Introducing a Benchmark — arXiv:2608.15255 — arXiv (en), https://arxiv.org/abs/2608.15255 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ca52f8e63e49 (Metraipolis archive dc_ca52f8e63e49, sha256 046482d8ba4ad8cc1357511f00f0babdf97d1bbf5101f0463ced32046317dd91)
BibTeX
@misc{dcca52f8e63e49,
title = {Towards Standardized Evaluation in Automated Domain Modeling: Introducing a Benchmark — arXiv:2608.15255},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.15255},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ca52f8e63e49; sha256 046482d8ba4ad8cc1357511f00f0babdf97d1bbf5101f0463ced32046317dd91},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.15255. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Domain modeling plays an essential role in domain-driven design, capturing essential entities and their relationships within a specific domain. Despite advancements in automated domain modeling, the absence of standardized benchmarks has hindered the comparative assessment of existing approaches. This paper introduces a benchmark designed to address this gap. The benchmark combines the 45-record Golden UML Modelset (Verbruggen et al., 2025) on Zenodo, as distributed by the Text2UML project of Calamo, Mecella, and Snoeck (Calamo et al., 2025), with the 8-record reference archive of Chen et al. (Chen et al., 2023a,b), enabling the evaluation of automated domain modeling approaches across different levels of complexity and scale. Given a natural language description, the task is to generate a corresponding domain model. For each description, a reference domain model is provided as ground truth. A metric is used to compare the generated domain model with the corresponding ground-truth model. To demonstrate the utility of the benchmark, we evaluate multiple automated domain modeling approaches, including heuristic rule-based methods and LLM-driven strategies. In accordance with the FAIR4RS recommendations (Chue Hong et al., 2022), the benchmark is provided as a research artifact to encourage reuse and support future research on automated domain modeling. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-18 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.15255 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T16:29:13.781Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).