Metraipolis › archive › dc_ecbf7e97812b

When Is a Conformal Guarantee Fair? Auditing Silent Subgroup Under-Coverage in Alzheimer's Disease Longitudinal Prediction — arXiv:2608.04254

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.04254
License (as archived)
CC0-1.0
Archived
2026-10-31T11:36:50.978Z
SHA-256 of the archived text
84f8e583241a9b1836723b2a1f0b8d3861cd0813d383b55a542d92fb9c3b8388
Stable URL of this page
https://metraipolis.com/documento/dc_ecbf7e97812b

How to cite

When Is a Conformal Guarantee Fair? Auditing Silent Subgroup Under-Coverage in Alzheimer's Disease Longitudinal Prediction — arXiv:2608.04254 — arXiv (en), https://arxiv.org/abs/2608.04254 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ecbf7e97812b (Metraipolis archive dc_ecbf7e97812b, sha256 84f8e583241a9b1836723b2a1f0b8d3861cd0813d383b55a542d92fb9c3b8388)
BibTeX
@misc{dcecbf7e97812b,
  title = {When Is a Conformal Guarantee Fair? Auditing Silent Subgroup Under-Coverage in Alzheimer's Disease Longitudinal Prediction — arXiv:2608.04254},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.04254},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ecbf7e97812b; sha256 84f8e583241a9b1836723b2a1f0b8d3861cd0813d383b55a542d92fb9c3b8388},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.04254. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Longitudinal prediction of Alzheimer's disease biomarkers increasingly informs clinical decisions, and a forecast is only useful if it also reports how much to trust it. Conformal prediction supplies this by wrapping any forecaster in a prediction band with a finite-sample coverage guarantee under exchangeability. However, standard population-level conformal prediction guarantees only marginal coverage and may mask substantial under-coverage within clinically important subgroups. We introduce a general mechanism-driven framework for auditing and repairing such subgroup under-coverage. Across two cohorts (ADNI, OASIS-3), two base forecasters, and nine attributes spanning genetic risk, demographics, and clinical severity, we find that population-level bands under-cover high-risk subgroups in 57 of 68 audited combinations, despite achieving nominal marginal coverage. We trace these failures to two mechanisms: (A) \emph{rarity}, where a group-conditional band calibrated on only $n$ patients covers at most $k/(n+1)$; and (B) \emph{tail-heaviness}, where a population-wide band is too narrow for a heavy-tailed subgroup and additional data cannot close the gap. Under-coverage falls disproportionately on patients with high genetic risk and disease severity (6.1 pp mean deficit, 95\% CI [3.3, 8.9]), while demographic groups remain at the target level on average (0.0 pp, CI [$-1.9$, 1.7]). We pair each mechanism with a corresponding conformal correction: cross-conformal pooling for rarity, per-subgroup calibration for tail-heaviness, and a coverage-safe marginal floor when both arise. Together, these corrections restore target coverage for nearly every high-risk subgroup across both cohorts and forecasters.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-06 in stat.ML).
Categorie arXiv: Methodology (stat.ME) ; Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2608.04254 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-31T11:26:57.119Z dalla pagina https://arxiv.org/catchup/stat.ML/2026-08-06?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).