Metraipolis › archive › dc_25218efe0d68
Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not — arXiv:2610.28539
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.28539
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-21T07:07:10.059Z
- SHA-256 of the archived text
65f5e59959dcb51e15aeeb99f3e149cfa48858ec2385dcaa2901bfc4a8bc5a19- Stable URL of this page
https://metraipolis.com/documento/dc_25218efe0d68
How to cite
Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not — arXiv:2610.28539 — arXiv (en), https://arxiv.org/abs/2610.28539 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_25218efe0d68 (Metraipolis archive dc_25218efe0d68, sha256 65f5e59959dcb51e15aeeb99f3e149cfa48858ec2385dcaa2901bfc4a8bc5a19)
BibTeX
@misc{dc25218efe0d68,
title = {Humans Correct Their Judgments Through Debate, but Weaker AI Models Do Not — arXiv:2610.28539},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.28539},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_25218efe0d68; sha256 65f5e59959dcb51e15aeeb99f3e149cfa48858ec2385dcaa2901bfc4a8bc5a19},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.28539. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
How can we effectively oversee AI systems that surpass human intelligence? AI Safety via Debate proposes that two AI systems argue opposing positions and a judge, either a human or a weaker model, decides which is correct. By facilitating supervisors in providing high-quality training signals, debate aims to encourage truthful and safe behavior from AI systems whose capabilities exceed our own. However, human judgment is not neutral: people often rely on biases which advanced AI systems may learn to exploit. Drawing on insights from collective intelligence and social cognition, this paper investigates whether debate can guide human and LLM supervisors toward the truth despite their prior beliefs. We evaluate several protocol configurations. We also explore setups inspired by the wisdom of the crowd such as the number and diversity of judges, as well as interaction mechanisms including deliberation and voting. Overall, we find that debate increases accuracy relative to prior beliefs for human judges, whereas the consultancy baseline, in which a single expert argues for one answer, does not. For weaker language models, however, the results are mixed: debate provides no comparable gains in most settings and can even reduce accuracy. Among multi-judge protocols, weighted voting produces the highest accuracy for human supervisors, whereas for LLMs none of them significantly improves group accuracy, even as the number of judges increases. Notably, the behavior of minority judges in non-diverse deliberation protocols suggests that, under symmetric settings, incorrect positions could be more persuasive than correct ones. These findings support debate as a viable path toward scalable human oversight, but cast doubt on its benefits for weaker AI supervisors, raising concerns about fully automated training and control pipelines in high-stakes settings. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.28539 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-21T07:05:43.487Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).