Metraipolis › archive › dc_82c4262bef28

Fairness Metrics based on the AUC in Clinical Predictive AI — arXiv:2611.05222

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.05222
License (as archived)
CC0-1.0
Archived
2026-11-04T12:30:48.405Z
SHA-256 of the archived text
4f0528d922dbb9ce34224c92b7bd023c8848e6d829ad55f559dcd53f4c349935
Stable URL of this page
https://metraipolis.com/documento/dc_82c4262bef28

How to cite

Fairness Metrics based on the AUC in Clinical Predictive AI — arXiv:2611.05222 — arXiv (en), https://arxiv.org/abs/2611.05222 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_82c4262bef28 (Metraipolis archive dc_82c4262bef28, sha256 4f0528d922dbb9ce34224c92b7bd023c8848e6d829ad55f559dcd53f4c349935)
BibTeX
@misc{dc82c4262bef28,
  title = {Fairness Metrics based on the AUC in Clinical Predictive AI — arXiv:2611.05222},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.05222},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_82c4262bef28; sha256 4f0528d922dbb9ce34224c92b7bd023c8848e6d829ad55f559dcd53f4c349935},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.05222. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Fairness evaluation of clinical prediction models for binary outcomes often involves fairness metrics that compare the area under the receiver operating characteristic curve (AUC, or c-statistic) across subgroups. However, the AUC has been shown to be a non-collapsible metric, meaning that its subgroup specific and overall values are not directly comparable as often implicitly assumed. This raises important questions about how existing AUC-based fairness metrics should be used and interpreted. We examine eight AUC-based fairness metrics proposed in the literature, including: within-group AUC parity; cross-group AUC (xAUC) parity; gap-to-overall AUC; equity-scaled AUC; minimum-based metrics; $\mathrm{xAUC}^1$; $\mathrm{xAUC}^0$; and $\mathrm{xAUC}^1$ or $\mathrm{xAUC}^0$ parity. We characterise their estimands, relate them to the decomposition of overall AUC (into within- and cross-group components), and critically appraise them. We then illustrate their behaviour using simulations based on the EuroSCORE II, a clinical prediction model for in-hospital mortality. We recommend reporting an AUC matrix, containing the overall AUC and all within- and cross-group AUC components, alongside population characteristics. When fairness metrics are needed, we recommend reporting the within-group AUC parity, with cross-group AUC parity providing supplementary information but requiring caution due to its potential conflict with calibration. Metrics involving $\mathrm{xAUC}^1$ and $\mathrm{xAUC}^0$ have merit, summarising within- and cross-group AUCs into single values, but their interpretation is non-trivial, and they should be used with caution. Gap-to-overall AUC, equity-scaled AUC, and minimum-based metrics compare quantities that should not be compared and it is unclear how to operationalise them, making them not fit for purpose and generally not recommended.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.05222 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-04T12:26:47.321Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).