Metraipolis › archive › dc_2b9937270b22

Too Much of the Same: From Algorithmic to Human Bias in Learning to Defer — arXiv:2608.28050

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.28050
License (as archived)
CC0-1.0
Archived
2026-10-17T11:05:40.335Z
SHA-256 of the archived text
7325b3880fc7e24704fddf64299dac15449d31573b4883d418e407c585c1b3e4
Stable URL of this page
https://metraipolis.com/documento/dc_2b9937270b22

How to cite

Too Much of the Same: From Algorithmic to Human Bias in Learning to Defer — arXiv:2608.28050 — arXiv (en), https://arxiv.org/abs/2608.28050 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2b9937270b22 (Metraipolis archive dc_2b9937270b22, sha256 7325b3880fc7e24704fddf64299dac15449d31573b4883d418e407c585c1b3e4)
BibTeX
@misc{dc2b9937270b22,
  title = {Too Much of the Same: From Algorithmic to Human Bias in Learning to Defer — arXiv:2608.28050},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.28050},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2b9937270b22; sha256 7325b3880fc7e24704fddf64299dac15449d31573b4883d418e407c585c1b3e4},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.28050. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Learning to Defer (LtD) extends supervised learning by allowing a Machine Learning (ML) model to defer harder or less confident decisions to a human expert. Despite being geared for human-AI collaboration, LtD strategies neglect the potential negative interference of human cognitive biases. Our contribution is twofold. First, we demonstrate that standard LtD strategies show class-dependent sampling bias in classification tasks in practice, and thus may disproportionately defer the minority classes when applied to imbalanced datasets. Second, we show that such asymmetries in task delegation may trigger human biases, ultimately leading to poorer downstream decision making. Specifically, we conduct a user study ($N=226$) where participants complete a classification task on a set of deferred items, with conditions presenting different levels of class imbalance. Our results show that participants exposed to a highly imbalanced rejection set achieved lower classification accuracy in the majority class compared to those exposed to a more balanced set, regardless of which class constituted the majority. Exploratory analyses suggest that this may be an instance of the Test-taker's effect, which stems from a mismatch between the actual distribution of classes and the participants' expectations about that distribution. Finally, we discuss the implications of these findings for the deployment of LtD algorithms.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-31 in cs.HC).
Categorie arXiv: Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2608.28050 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T10:50:06.207Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-08-31?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).