Metraipolis › archive › dc_cfd374ccfdc3

A Plasmode Benchmark Can Refute but Cannot Certify: Projection and Regularity in Causal-Inference Simulation — arXiv:2609.26186

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.26186
License (as archived)
CC0-1.0
Archived
2026-10-08T15:50:24.493Z
SHA-256 of the archived text
cff0165ec193e0ca7dc598a8ef2e3a9e31e229a07b627fe7db7b23650c8fb69f
Stable URL of this page
https://metraipolis.com/documento/dc_cfd374ccfdc3

How to cite

A Plasmode Benchmark Can Refute but Cannot Certify: Projection and Regularity in Causal-Inference Simulation — arXiv:2609.26186 — arXiv (en), https://arxiv.org/abs/2609.26186 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cfd374ccfdc3 (Metraipolis archive dc_cfd374ccfdc3, sha256 cff0165ec193e0ca7dc598a8ef2e3a9e31e229a07b627fe7db7b23650c8fb69f)
BibTeX
@misc{dccfd374ccfdc3,
  title = {A Plasmode Benchmark Can Refute but Cannot Certify: Projection and Regularity in Causal-Inference Simulation — arXiv:2609.26186},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.26186},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cfd374ccfdc3; sha256 cff0165ec193e0ca7dc598a8ef2e3a9e31e229a07b627fe7db7b23650c8fb69f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.26186. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Plasmode simulation - resampling covariates, and often treatment, from a real cohort and regenerating the outcome from a model with an injected effect - is a standard tool for comparing causal-inference estimators. We argue that its validity turns on two separable design choices, and that separating them clarifies a recent debate over resampling versus regenerating the treatment. Our central message limits what such a benchmark can show: a plasmode can refute a universal claim about an estimator but cannot certify one. Refuting needs only that the simulated data genuinely belong to the class over which a guarantee is quoted; certifying also needs the benchmark's difficulty to carry over to the target population, which the analyst cannot verify. Two choices set that difficulty. Regularity is whether the simulated law preserves the overlap that inverse-weighting and targeted-learning theory require. Resampling the real treatment with fine-grained covariates destroys it, and the resulting coverage failure falls on flexible, machine-learning-based estimators, while parametric-nuisance estimators - including inverse-probability weighting - stay near nominal; it disappears once the treatment is regenerated from a bounded propensity or the covariates are coarsened, and cross-fitting removes only part of it. Projection is that the injected outcome model hands a matching estimator the right answer by construction; this survives the regularity fix and can reverse estimator rankings even when overlap is intact. We give a regular-plasmode algorithm, a confirming real-data simulation, and practical recommendations. A plasmode is a filter against estimators, not a warrant for them.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-23 in stat.ME).
Categorie arXiv: Methodology (stat.ME) ; Statistics Theory (math.ST).
Pagina del lavoro: https://arxiv.org/abs/2609.26186 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T15:07:51.399Z dalla pagina https://arxiv.org/catchup/stat.ME/2026-09-23?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).