Metraipolis › archive › dc_024fd0c0054b
Cohen's f or Mean Standardized Differences? Assessing Covariate Balance with Multivalued Treatments — arXiv:2608.10266
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.10266
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:25:20.749Z
- SHA-256 of the archived text
97754083db0e2a0cdd06a5b17e177b8809e8bd19020caa0b23582f84e656610e- Stable URL of this page
https://metraipolis.com/documento/dc_024fd0c0054b
How to cite
Cohen's f or Mean Standardized Differences? Assessing Covariate Balance with Multivalued Treatments — arXiv:2608.10266 — arXiv (en), https://arxiv.org/abs/2608.10266 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_024fd0c0054b (Metraipolis archive dc_024fd0c0054b, sha256 97754083db0e2a0cdd06a5b17e177b8809e8bd19020caa0b23582f84e656610e)
BibTeX
@misc{dc024fd0c0054b,
title = {Cohen's f or Mean Standardized Differences? Assessing Covariate Balance with Multivalued Treatments — arXiv:2608.10266},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.10266},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_024fd0c0054b; sha256 97754083db0e2a0cdd06a5b17e177b8809e8bd19020caa0b23582f84e656610e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10266. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Assessing covariate balance across more than two treatment groups has no established omnibus standard: the prevailing practice averages, or takes the maximum of, pairwise standardized mean differences (SMD), while Cohen's f - the classical generalization of Cohen's d to more than two groups - offers an alternative grounded in an established effect-size framework, but the two have not been formally compared. We extend both to arbitrary weighted and covariate-adjusted models via a community-contributed Stata command, esizereg, and validate them in a simulation study of three, four, and six treatment groups under correctly specified and misspecified generalized-propensity-score weighting, correlating each statistic against downstream treatment-effect bias. Cohen's f tracks estimation bias comparably to mean absolute SMD, both pooled (r = 0.93) and within weighting arm (r approximately 0.79); maximum absolute SMD is generally weakest. This ranking was unchanged under a deliberately adversarial nonlinear/interaction outcome model. Cohen's f and the SMD-based statistics are not numerically comparable: we derive an exact representation of f as a size-weighted quadratic function of the pairwise SMDs and prove the minimum attainable ratio between f and mean absolute SMD under equal group weights, so conventional SMD thresholds should not apply directly to f. We recommend reporting f alongside its per-level and pairwise decomposition. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-12 in stat.ME). Categorie arXiv: Methodology (stat.ME). Pagina del lavoro: https://arxiv.org/abs/2608.10266 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T06:16:10.985Z dalla pagina https://arxiv.org/catchup/stat.ME/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).