Metraipolis › archive › dc_b0fc2cc25202

WideSWE: Can Coding Agents Coordinate Changes Across Repositories? — arXiv:2609.33382

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.33382
License (as archived)
CC0-1.0
Archived
2026-10-07T23:02:10.927Z
SHA-256 of the archived text
2e093ecdb77d1fa948978a70618bbc26f9a58d2d7fbb3647e64be69a1b759b1b
Stable URL of this page
https://metraipolis.com/documento/dc_b0fc2cc25202

How to cite

WideSWE: Can Coding Agents Coordinate Changes Across Repositories? — arXiv:2609.33382 — arXiv (en), https://arxiv.org/abs/2609.33382 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b0fc2cc25202 (Metraipolis archive dc_b0fc2cc25202, sha256 2e093ecdb77d1fa948978a70618bbc26f9a58d2d7fbb3647e64be69a1b759b1b)
BibTeX
@misc{dcb0fc2cc25202,
  title = {WideSWE: Can Coding Agents Coordinate Changes Across Repositories? — arXiv:2609.33382},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.33382},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b0fc2cc25202; sha256 2e093ecdb77d1fa948978a70618bbc26f9a58d2d7fbb3647e64be69a1b759b1b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33382. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Coding-agent evaluation has progressed from resolving individual issues to carrying out long-horizon development, yet task completion is still largely assessed within a single codebase. In software ecosystems, many features and bug fixes require coordinated changes across multiple repositories. We introduce WideSWE to evaluate coding agents on such cross-repository tasks. Mining and reviewing changes across 103 software ecosystems yields 120 real-world tasks, balanced between 60 bug fixes and 60 features. We derive prompts from related issues and pull requests. We systematically review and adapt hidden tests to support diverse correct implementations while preserving required behavior and regression checks. Across seven agent configurations, full task success ranges from 10.83% to 42.50%, with the configuration pairing Codex CLI with GPT-5.6-sol achieving the highest rate. Trajectories show agents failing to identify necessary changes, recognizing changes but leaving them unfinished, or modifying the required repositories without fully satisfying the request. To examine whether working on one repository at a time can alleviate these difficulties, we compare it with joint execution under identical prompts. Independent execution mainly recovers omitted work and is less effective at correcting previously attempted but unsuccessful implementations. Joint execution can use information from related repositories to guide implementation and verification. Code is available at this https URL .

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-29 in cs.SE).
Categorie arXiv: Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2609.33382 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T22:39:35.195Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).