Metraipolis › archive › dc_cc2fe95ce46a

A Theory of Post-hoc Debate Judgement — arXiv:2608.19002

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.19002
License (as archived)
CC0-1.0
Archived
2026-10-18T13:44:40.864Z
SHA-256 of the archived text
449c8c6c721b1e1729cff58dafa5c6643b24b23670948048259639280ec014ea
Stable URL of this page
https://metraipolis.com/documento/dc_cc2fe95ce46a

How to cite

A Theory of Post-hoc Debate Judgement — arXiv:2608.19002 — arXiv (en), https://arxiv.org/abs/2608.19002 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cc2fe95ce46a (Metraipolis archive dc_cc2fe95ce46a, sha256 449c8c6c721b1e1729cff58dafa5c6643b24b23670948048259639280ec014ea)
BibTeX
@misc{dccc2fe95ce46a,
  title = {A Theory of Post-hoc Debate Judgement — arXiv:2608.19002},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.19002},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cc2fe95ce46a; sha256 449c8c6c721b1e1729cff58dafa5c6643b24b23670948048259639280ec014ea},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.19002. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Debates have recently emerged as a useful methodology for agentic AI to improve performance as well as to aid explainability and user engagement. For example, LLM-empowered agents may debate internally (with themselves) and/or externally (with other agents). In many settings where debates are used, debates' outcomes and resulting outputs are determined post-hoc by external judges, often LLMs. In this paper we develop and test a novel theory of debate judgement applicable to all settings where agents engage in debates by providing pros and cons for their opinions therein. Specifically, we identify a number of formal properties that debate judgement may be required to satisfy in general, as concerns reproducibility, robustness, groundedness and explainability. Then, we explore their satisfaction formally and/or experimentally, for claim verification settings, for two specific alternative debate judgement methods: variants of the LLMs as a judge idea and formal semantics drawn from computational argumentation. We show that the two methods give similar accuracy performances but the former may lack formal guarantees that the latter brings. Overall, our study indicates argumentation semantics as an ideal candidate for principled judges in debate-driven AI.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-20 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.19002 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T13:41:17.888Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-20?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).