Metraipolis › archive › dc_78b579ef2a3d

DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems? — arXiv:2611.03523

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.03523
License (as archived)
CC0-1.0
Archived
2026-11-03T11:12:54.045Z
SHA-256 of the archived text
ea3aacea165b5a4966e43f61ea187aa44666a0fe326dea08cd0a533d58253827
Stable URL of this page
https://metraipolis.com/documento/dc_78b579ef2a3d

How to cite

DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems? — arXiv:2611.03523 — arXiv (en), https://arxiv.org/abs/2611.03523 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_78b579ef2a3d (Metraipolis archive dc_78b579ef2a3d, sha256 ea3aacea165b5a4966e43f61ea187aa44666a0fe326dea08cd0a533d58253827)
BibTeX
@misc{dc78b579ef2a3d,
  title = {DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems? — arXiv:2611.03523},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.03523},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_78b579ef2a3d; sha256 ea3aacea165b5a4966e43f61ea187aa44666a0fe326dea08cd0a533d58253827},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.03523. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

LLM agents show strong potential in software engineering tasks such as competitive programming and code synthesis. Existing benchmarks, however, largely focus on small-scale settings such as self-contained Python modules, leaving distributed systems, an essential class of production software, under-examined. We introduce DistDebug-Bench, a benchmark for evaluating agents' ability to diagnose complex-system failures at the code level. It curates 120 high-quality real-world bugs from 11 widely used distributed systems, spanning 5 programming languages and 10 failure patterns. Through an extensive evaluation of state-of-the-art LLMs and agents, we identify substantial gaps between current agents and real-world debugging tasks. A recurring gap is tunnel vision due to a lack of explicit reasoning structure and nondeterminism from inconsistent tool-use scope. The benchmark and evaluator are available at this https URL , with agent traces and a leaderboard at this https URL .

Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.DC, nuovi lavori del giorno).
Categorie arXiv: Software Engineering (cs.SE) ; Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.03523 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T11:00:07.188Z dalla pagina https://arxiv.org/list/cs.DC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).