Metraipolis › archive › dc_70c8eadee80e

Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report — arXiv:2608.11965

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.11965
License (as archived)
CC0-1.0
Archived
2026-10-19T05:42:49.112Z
SHA-256 of the archived text
b44ac05f9031e708f372a0b193b2a926f88cd9b85d925e57c86fb77864184c1e
Stable URL of this page
https://metraipolis.com/documento/dc_70c8eadee80e

How to cite

Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report — arXiv:2608.11965 — arXiv (en), https://arxiv.org/abs/2608.11965 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_70c8eadee80e (Metraipolis archive dc_70c8eadee80e, sha256 b44ac05f9031e708f372a0b193b2a926f88cd9b85d925e57c86fb77864184c1e)
BibTeX
@misc{dc70c8eadee80e,
  title = {Developing LLM-based Multi-Agent Systems in Software Engineering: A Mixed-Method Experience Report — arXiv:2608.11965},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.11965},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_70c8eadee80e; sha256 b44ac05f9031e708f372a0b193b2a926f88cd9b85d925e57c86fb77864184c1e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.11965. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

The proliferation of Generative Artificial Intelligence (Gen AI) powered by large language models (LLMs) has transformed the software development process, introducing new paradigms for code generation, debugging, testing, and maintenance. While early applications focused on leveraging single, independent LLMs to assist developers with isolated tasks, recent advances have shifted toward multi-agent systems (MAS) that orchestrate multiple LLM-based agents working collaboratively toward common objectives. Despite their promising potential, using MAS encompasses a set of challenges for developers who have to carefully select the right technology, devise proper coordination rules, and design specific roles for the involved agents. In this paper, we provide a comprehensive overview of the existing tools and frameworks for implementing MAS in software engineering. First, we conducted a quantitative analysis of the most relevant open source MAS frameworks by evaluating their documentation, features, and capabilities from the developers' perspective. Second, we performed a qualitative evaluation of a subset of the selected frameworks by implementing a common use case: the summarization of this http URL files. The findings show that the selected frameworks provide a good coverage of fundamental components of MAS, though advanced features such as telemetry of agents are still missing. In addition, the empirical evaluation shows that there is no significant difference in terms of ROUGE scores considering the summarization task. Finally, we provide a set of lessons learned and challenges that can help researchers and practitioners to select a suitable MAS framework according to their needs.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-13 in cs.SE).
Categorie arXiv: Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2608.11965 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T05:31:21.759Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-13?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).