Metraipolis › archive › dc_cec7282c6407

A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems — arXiv:2608.05791

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.05791
License (as archived)
CC0-1.0
Archived
2026-10-25T20:48:23.916Z
SHA-256 of the archived text
88e87cafd8a970415e4b5d064965c4b3ecba9781fe5e6eae368c1b66ae39ce8f
Stable URL of this page
https://metraipolis.com/documento/dc_cec7282c6407

How to cite

A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems — arXiv:2608.05791 — arXiv (en), https://arxiv.org/abs/2608.05791 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cec7282c6407 (Metraipolis archive dc_cec7282c6407, sha256 88e87cafd8a970415e4b5d064965c4b3ecba9781fe5e6eae368c1b66ae39ce8f)
BibTeX
@misc{dccec7282c6407,
  title = {A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems — arXiv:2608.05791},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.05791},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cec7282c6407; sha256 88e87cafd8a970415e4b5d064965c4b3ecba9781fe5e6eae368c1b66ae39ce8f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.05791. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language model (LLM)-driven multi-agent systems typically require multiple model invocations and complex coordination during inference, and their execution strategies directly affect system accuracy, latency, and computational cost. Parallel execution provides a means to improve inference-time efficiency. From the perspective of inference-time execution, this paper models parallelism in multi-agent systems as two distinct levels of decision processes: Replica Parallelism, which explores multiple complete solution paths at the task level, and Structural Parallelism, which enables concurrent execution within a single solution path through task decomposition. However, the roles of different forms of parallelism and their interrelationships still lack systematic study in terms of unified organization and coordination. We therefore propose TIPEX, a controllable execution framework that unifies these two levels of parallelism and coordinates their roles within the inference process under a unified execution semantics while supporting systematic combinations and analyses of different parallel strategies and parameter configurations. Systematic experiments on the GAIA benchmark demonstrate that inference-time parallelism can significantly improve accuracy and reduce end-to-end latency at the cost of increased token consumption. Further analysis shows that Replica and Structural Parallelism exhibit complementary effects across task complexities, with tasks of intermediate difficulty benefiting most from their coordination, while overly aggressive parallel strategies do not necessarily yield better performance.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-07 in cs.MA).
Categorie arXiv: Multiagent Systems (cs.MA) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.05791 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-25T20:47:44.134Z dalla pagina https://arxiv.org/catchup/cs.MA/2026-08-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).