Metraipolis › archive › dc_b335cab50271
Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details — arXiv:2608.03644
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.03644
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-31T12:14:40.285Z
- SHA-256 of the archived text
3c851ce122b13ec3ef238ec921c54f3c9b1ca543f2ee2171b6df93fcbeef8f51- Stable URL of this page
https://metraipolis.com/documento/dc_b335cab50271
How to cite
Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details — arXiv:2608.03644 — arXiv (en), https://arxiv.org/abs/2608.03644 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b335cab50271 (Metraipolis archive dc_b335cab50271, sha256 3c851ce122b13ec3ef238ec921c54f3c9b1ca543f2ee2171b6df93fcbeef8f51)
BibTeX
@misc{dcb335cab50271,
title = {Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Details — arXiv:2608.03644},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.03644},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b335cab50271; sha256 3c851ce122b13ec3ef238ec921c54f3c9b1ca543f2ee2171b6df93fcbeef8f51},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.03644. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
AI agents deployed in real-world settings must be capable of coordinating with humans and other AI agents they have not encountered before. Zero-shot coordination (ZSC) algorithms aim to achieve this by specifying high-level learning rules such that independently engineered agents can coordinate with each other at test time. Rigorous evaluation of ZSC algorithms remains difficult: ideally, multiple independent implementations of each proposed algorithm must be used, reflecting the variation that arises when independent parties interpret and implement the same specification. In practice, however, ZSC algorithms have almost exclusively been evaluated using a single implementation trained across different random seeds, with only a handful of works additionally varying the neural network architecture. This leaves open questions about robustness to specification ambiguities and implementation details. In this work, we provide the first systematic evaluation of this robustness. We introduce a new evaluation scheme, cross-implementation cross-play, varying implementation details that prior work has shown to affect the performance of multi-agent reinforcement learning (MARL) algorithms, and we evaluate Other-Play, a popular ZSC algorithm, with this scheme. Our findings are encouraging and suggest that, for Other-Play, the standard ZSC evaluation is, in fact, a reasonable proxy for this more thorough cross-implementation evaluation. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-05 in cs.MA). Categorie arXiv: Artificial Intelligence (cs.AI) ; Multiagent Systems (cs.MA). Pagina del lavoro: https://arxiv.org/abs/2608.03644 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-31T12:05:27.225Z dalla pagina https://arxiv.org/catchup/cs.MA/2026-08-05?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).