Metraipolis › archive › dc_55a620e67950

OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems — arXiv:2609.21527

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.21527
License (as archived)
CC0-1.0
Archived
2026-10-10T01:45:08.268Z
SHA-256 of the archived text
9e8e49328cde0b6b817c70cea393b3779fd4eee8a665316857ee1e1824def503
Stable URL of this page
https://metraipolis.com/documento/dc_55a620e67950

How to cite

OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems — arXiv:2609.21527 — arXiv (en), https://arxiv.org/abs/2609.21527 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_55a620e67950 (Metraipolis archive dc_55a620e67950, sha256 9e8e49328cde0b6b817c70cea393b3779fd4eee8a665316857ee1e1824def503)
BibTeX
@misc{dc55a620e67950,
  title = {OpenMAS-GCom. A Diagnostic Benchmark for Graph-enhanced Multi-Agent Systems — arXiv:2609.21527},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.21527},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_55a620e67950; sha256 9e8e49328cde0b6b817c70cea393b3779fd4eee8a665316857ee1e1824def503},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.21527. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Graph-enhanced multi-agent systems (G-MAS) coordinate large language model agents through communication graphs and role assignments, which determine how agents exchange information and divide responsibilities. However, final-score comparisons across systems combine differences in models, communication patterns, roles, and computation costs, making performance differences difficult to attribute to specific communication structures, role assignments, and information flows. To address this evaluation attribution problem, we introduce OpenMAS-GCom, a benchmark for diagnosing how these components affect G-MAS performance through controlled interventions. We represent systems through collaboration units, communication links, shared intermediate information, and execution rules. OpenMAS-GCom compares original systems with versions modified by changing one component while keeping tasks, models, prompts, and budget limits fixed. We rewire communication edges, remove specialist or critic agents, replace intermediate messages with incorrect content, and disable workers during execution. The benchmark evaluates 17 single-agent, ordinary multi-agent, and graph-enhanced configurations on 29 datasets across six domains. We add 400 G-MAS-Complex tasks requiring agents to combine information from multiple documents, resolve conflicting records, and return specified values with source identifiers. Experiments show larger mean losses after specialist removal than after critic removal, different performance degradation under incorrect messages and worker failures despite similar original scores, and different configurations achieving the highest accuracy and accuracy per token on G-MAS-Complex.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-21 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2609.21527 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-10T01:14:16.636Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-21?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).