Metraipolis › archive › dc_d756cf0a3249
Large Language Models for Requirements Engineering: A Cross-Task Empirical Evaluation — arXiv:2608.21531
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.21531
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T08:12:21.648Z
- SHA-256 of the archived text
c9c6ac268b8a2d991f3ff1a43570f5c788d234f475fb565bb60c2381c1159f69- Stable URL of this page
https://metraipolis.com/documento/dc_d756cf0a3249
How to cite
Large Language Models for Requirements Engineering: A Cross-Task Empirical Evaluation — arXiv:2608.21531 — arXiv (en), https://arxiv.org/abs/2608.21531 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d756cf0a3249 (Metraipolis archive dc_d756cf0a3249, sha256 c9c6ac268b8a2d991f3ff1a43570f5c788d234f475fb565bb60c2381c1159f69)
BibTeX
@misc{dcd756cf0a3249,
title = {Large Language Models for Requirements Engineering: A Cross-Task Empirical Evaluation — arXiv:2608.21531},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.21531},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d756cf0a3249; sha256 c9c6ac268b8a2d991f3ff1a43570f5c788d234f475fb565bb60c2381c1159f69},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.21531. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Requirements-related information is scattered across heterogeneous artefacts such as user feedback, developer discussions, and software repositories, making the extraction of actionable requirements knowledge labour-intensive and hard to scale. Large Language Models (LLMs) can support many Requirements Engineering (RE) activities, from classification and traceability identification to specification and explanation generation, but existing evidence is fragmented across tasks, artefact types, and evaluation settings, and studies rarely offer cross-task evaluations or replication packages. We present two complementary empirical studies evaluating LLMs across five RE-related activities. The first is a controlled experiment on five lightweight open-source LLMs for feedback-driven requirements classification and specification generation. The second is an exploratory industrial case study on two frontier LLMs for traceability link identification and traceability explanation generation using real project artefacts. Classification and traceability identification were assessed with quantitative metrics, and generation tasks through human evaluation. LLM performance is strongly task-dependent, ranging from moderate to high, and no single model consistently outperformed the others, indicating that effective adoption depends on selecting models and prompting strategies per task. Our contributions are: (i) the first cross-task empirical evaluation of LLMs spanning five RE-related activities, (ii) replication materials supporting reproducibility, and (iii) a broader understanding of the capabilities, limitations, and practical readiness of current LLMs for RE. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-25 in cs.SE). Categorie arXiv: Software Engineering (cs.SE). Pagina del lavoro: https://arxiv.org/abs/2608.21531 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T08:07:32.990Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).