Metraipolis › archive › dc_eb8000f27653
AsynCodeBench: Benchmarking Collaboration of Asynchronous Multi-Agent Systems in Software Engineering — arXiv:2609.32662
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.32662
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T20:54:05.657Z
- SHA-256 of the archived text
0fa2f5d3169c4ec300982a816904f902308f1921a596b149108895e23b0a0d33- Stable URL of this page
https://metraipolis.com/documento/dc_eb8000f27653
How to cite
AsynCodeBench: Benchmarking Collaboration of Asynchronous Multi-Agent Systems in Software Engineering — arXiv:2609.32662 — arXiv (en), https://arxiv.org/abs/2609.32662 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_eb8000f27653 (Metraipolis archive dc_eb8000f27653, sha256 0fa2f5d3169c4ec300982a816904f902308f1921a596b149108895e23b0a0d33)
BibTeX
@misc{dceb8000f27653,
title = {AsynCodeBench: Benchmarking Collaboration of Asynchronous Multi-Agent Systems in Software Engineering — arXiv:2609.32662},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.32662},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_eb8000f27653; sha256 0fa2f5d3169c4ec300982a816904f902308f1921a596b149108895e23b0a0d33},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.32662. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Multi-agent coding has emerged as an increasingly active direction in software engineering, where complex development tasks are decomposed across multiple specialized agents working on different parts of the problem. Despite the shift from individual problem solving to distributed collaboration, multi-agent systems still lack a direct measure of collaboration and are largely evaluated through task-level outcomes inherited from single-agent coding, conflating individual coding capability with cross-agent coordination. We introduce AsynCodeBench, a dependency-centric benchmark for asynchronous multi-agent software engineering that represents each task with an explicit dependency graph and executable Dependency Checkers. Through this dependency-tracking process, we propose two complementary measures: Asynchronous Dependency Pass Rate (ADPR), which measures how many cross-agent dependencies are ultimately satisfied, and Dependency Resolution Step (DRS), which measures when each dependency first becomes satisfied during execution. AsynCodeBench comprises 19 tasks from real-world repositories, exposing 52 directed dependencies as explicit units for evaluating cross-agent collaboration. Experiments across model families, scales, and generations reveal a clear gap between coding and collaboration capability: improvements in coding performance do not necessarily translate into stronger collaboration, and task-level metrics can diverge substantially from dependency-level collaboration measures. Dependency-trajectory analysis further reveals that successful coordination often emerges not gradually, but through concentrated bursts in which many dependencies become resolved over a short portion of the execution trajectory, a pattern we term a hopping window. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.MA). Categorie arXiv: Software Engineering (cs.SE) ; Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA). Pagina del lavoro: https://arxiv.org/abs/2609.32662 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:24:41.670Z dalla pagina https://arxiv.org/catchup/cs.MA/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).