Metraipolis › archive › dc_580db1f5d4bd

A Causal Inference Approach for Evaluating Diagnostic Tests and AI-Enabled Medical Devices: From Effect Modification to Information-Augmented Decision-Making — arXiv:2608.19501

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.19501
License (as archived)
CC0-1.0
Archived
2026-10-18T11:52:01.124Z
SHA-256 of the archived text
30707f954651d3ad7b4c453c2c7ceec0c97c3967cf07af452e30d1337641be96
Stable URL of this page
https://metraipolis.com/documento/dc_580db1f5d4bd

How to cite

A Causal Inference Approach for Evaluating Diagnostic Tests and AI-Enabled Medical Devices: From Effect Modification to Information-Augmented Decision-Making — arXiv:2608.19501 — arXiv (en), https://arxiv.org/abs/2608.19501 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_580db1f5d4bd (Metraipolis archive dc_580db1f5d4bd, sha256 30707f954651d3ad7b4c453c2c7ceec0c97c3967cf07af452e30d1337641be96)
BibTeX
@misc{dc580db1f5d4bd,
  title = {A Causal Inference Approach for Evaluating Diagnostic Tests and AI-Enabled Medical Devices: From Effect Modification to Information-Augmented Decision-Making — arXiv:2608.19501},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.19501},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_580db1f5d4bd; sha256 30707f954651d3ad7b4c453c2c7ceec0c97c3967cf07af452e30d1337641be96},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.19501. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Diagnostic medical tests and devices provide useful information for evaluating the potential benefits and risks of therapeutic treatments. However, unlike treatments, their impact on health outcomes is generally indirect because measuring diagnostic information typically does not itself affect patient outcomes, which complicates evaluation of their effectiveness. In this work, we develop a causal inference approach for evaluating diagnostic tests by distinguishing explanatory and pragmatic effectiveness. Explanatory effectiveness evaluates whether a diagnostic test result provides treatment-relevant information beyond baseline covariates by explaining additional treatment-effect heterogeneity, which we characterize using a variance-based treatment-effect variable importance measure. Pragmatic effectiveness evaluates whether incorporating this information into personalized treatment decisions improves expected outcomes, a question central to decision-making for patients, clinicians, and other health care stakeholders. We formalize pragmatic effectiveness as a contrast between expected outcomes under optimal personalized treatment rules defined with and without access to the diagnostic test result. We establish identification of the proposed estimand and provide Targeted Maximum Likelihood Estimation (TMLE) and cross-validated TMLE procedures for nonparametric estimation and inference. Simulation studies and a synthetic colorectal cancer application illustrate the proposed estimands and estimation performance. More broadly, this approach provides a causal inference perspective for evaluating AI-enabled devices by distinguishing their dual roles as information-enrichment and personalized decision-optimization tools, clarifying whether AI improves outcomes by expanding information for downstream decisions, improving the decision rule used to act on that information, or through both pathways.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-21 in stat.ML).
Categorie arXiv: Methodology (stat.ME) ; Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2608.19501 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T11:49:10.013Z dalla pagina https://arxiv.org/catchup/stat.ML/2026-08-21?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).