Metraipolis › archive › dc_ca52f8e63e49

Towards Standardized Evaluation in Automated Domain Modeling: Introducing a Benchmark — arXiv:2608.15255

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.15255
License (as archived)
CC0-1.0
Archived
2026-10-18T17:13:32.713Z
SHA-256 of the archived text
046482d8ba4ad8cc1357511f00f0babdf97d1bbf5101f0463ced32046317dd91
Stable URL of this page
https://metraipolis.com/documento/dc_ca52f8e63e49

How to cite

Towards Standardized Evaluation in Automated Domain Modeling: Introducing a Benchmark — arXiv:2608.15255 — arXiv (en), https://arxiv.org/abs/2608.15255 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ca52f8e63e49 (Metraipolis archive dc_ca52f8e63e49, sha256 046482d8ba4ad8cc1357511f00f0babdf97d1bbf5101f0463ced32046317dd91)
BibTeX
@misc{dcca52f8e63e49,
  title = {Towards Standardized Evaluation in Automated Domain Modeling: Introducing a Benchmark — arXiv:2608.15255},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.15255},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ca52f8e63e49; sha256 046482d8ba4ad8cc1357511f00f0babdf97d1bbf5101f0463ced32046317dd91},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.15255. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Domain modeling plays an essential role in domain-driven design, capturing essential entities and their relationships within a specific domain. Despite advancements in automated domain modeling, the absence of standardized benchmarks has hindered the comparative assessment of existing approaches. This paper introduces a benchmark designed to address this gap. The benchmark combines the 45-record Golden UML Modelset (Verbruggen et al., 2025) on Zenodo, as distributed by the Text2UML project of Calamo, Mecella, and Snoeck (Calamo et al., 2025), with the 8-record reference archive of Chen et al. (Chen et al., 2023a,b), enabling the evaluation of automated domain modeling approaches across different levels of complexity and scale. Given a natural language description, the task is to generate a corresponding domain model. For each description, a reference domain model is provided as ground truth. A metric is used to compare the generated domain model with the corresponding ground-truth model. To demonstrate the utility of the benchmark, we evaluate multiple automated domain modeling approaches, including heuristic rule-based methods and LLM-driven strategies. In accordance with the FAIR4RS recommendations (Chue Hong et al., 2022), the benchmark is provided as a research artifact to encourage reuse and support future research on automated domain modeling.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-18 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.15255 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T16:29:13.781Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).