Metraipolis › archive › dc_198dc3389bc0

The Code of Theseus: Can Agents Rebuild Software from Recovered Design Documents? — arXiv:2610.20068

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.20068
License (as archived)
CC0-1.0
Archived
2026-10-15T21:48:56.198Z
SHA-256 of the archived text
c1a7ae3b571678247bca866b7ab547ee5520c53ed787b9e82f339dca2b987fa9
Stable URL of this page
https://metraipolis.com/documento/dc_198dc3389bc0

How to cite

The Code of Theseus: Can Agents Rebuild Software from Recovered Design Documents? — arXiv:2610.20068 — arXiv (en), https://arxiv.org/abs/2610.20068 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_198dc3389bc0 (Metraipolis archive dc_198dc3389bc0, sha256 c1a7ae3b571678247bca866b7ab547ee5520c53ed787b9e82f339dca2b987fa9)
BibTeX
@misc{dc198dc3389bc0,
  title = {The Code of Theseus: Can Agents Rebuild Software from Recovered Design Documents? — arXiv:2610.20068},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.20068},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_198dc3389bc0; sha256 c1a7ae3b571678247bca866b7ab547ee5520c53ed787b9e82f339dca2b987fa9},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.20068. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

LLM agents increasingly design a system before implementing it, yet the data to train and evaluate them centres on implementation and testing: requirements and design artefacts are often missing, outdated or private. Source code, in contrast, is abundant. Prior work recovers architecture documentation by feeding LLMs the source code or letting agents explore it, which saturates the context, does not scale to many repositories, and yields a single artefact rather than aligned ones. We present a framework that recovers aligned stakeholder intent, requirements and architecture from a compact repository representation, a static dependency graph and key contextual files, and release the artefacts of 10,764 Java, Python, C/C++ and C# repositories as a dataset. An LLM judge rates the artefacts of three generators as clear and internally consistent, but less reliably correct and at the right level of abstraction. To test whether the artefacts carry the design, we pose a software Ship of Theseus: a coding agent rebuilds 29 Commit0 libraries from the intent alone or with the recovered requirements and architecture, given only an interface contract and part of the tests. The artefacts do not significantly change the held-out pass rate (33.7% vs. 35.8%), but bring the rebuilt module structure significantly closer to the original (module F1 from 0.54 to 0.63), with either generator and even with concise artefacts. Recovered artefacts thus convey design that tests do not capture, offering a scalable source of design-level data for agents that design before they implement, and the round trip measures this without human references.

Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.SE, nuovi lavori del giorno).
Categorie arXiv: Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2610.20068 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T21:34:29.593Z dalla pagina https://arxiv.org/list/cs.SE/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).