Metraipolis › archive › dc_9b663bf21665
Complementarity without ground truth? — arXiv:2611.10893
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.10893
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-10T18:41:17.560Z
- SHA-256 of the archived text
727d3db6c6a53bbded1b42f0e1b5f9a01379046d5149a92f8dcb2ca9be23e36f- Stable URL of this page
https://metraipolis.com/documento/dc_9b663bf21665
How to cite
Complementarity without ground truth? — arXiv:2611.10893 — arXiv (en), https://arxiv.org/abs/2611.10893 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9b663bf21665 (Metraipolis archive dc_9b663bf21665, sha256 727d3db6c6a53bbded1b42f0e1b5f9a01379046d5149a92f8dcb2ca9be23e36f)
BibTeX
@misc{dc9b663bf21665,
title = {Complementarity without ground truth? — arXiv:2611.10893},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.10893},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9b663bf21665; sha256 727d3db6c6a53bbded1b42f0e1b5f9a01379046d5149a92f8dcb2ca9be23e36f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.10893. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Human-AI complementarity captures the idea that a human assisted by an AI system can outperform both the human and the AI acting alone. In prediction tasks, this improvement is assessed against ground truth labels produced through a reference construction procedure and intended to represent the state of affairs to be predicted. Many human-AI interactions, including those where medical AI provides treatment recommendations, however, concern tasks other than predicting what obtains. Their relevant output concerns adequacy relative to a practical goal and depends on several evaluative dimensions. In this work, we examine the ground truth dependence of complementarity and extend it to human-AI interactions where ground truth is not the appropriate reference. We show that tasks beyond prediction can still admit a reference construction procedure that generates adequacy labels. We develop a route for extending complementarity to such settings. It replaces ground truth labels with context-dependent adequacy labels generated through a two-step scoring methodology inspired by multi-criteria decision analysis frameworks in healthcare and it makes the normative choices underlying reference construction explicit. Because the construction of adequacy labels embeds evaluative choices, we draw methodological inspiration from computational reliabilism to identify technical, scientific, and social factors relevant to supporting their construction. Our approach expands the empirical study of human-AI complementarity beyond prediction tasks, enabling its quantitative evaluation in decision-support settings where ground truth is not the appropriate evaluative reference. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Human-Computer Interaction (cs.HC). Pagina del lavoro: https://arxiv.org/abs/2611.10893 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-10T18:37:37.508Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).