Metraipolis › archive › dc_cec05ead2576

Detection coherence of tests — arXiv:2608.11177

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.11177
License (as archived)
CC0-1.0
Archived
2026-10-19T06:25:26.081Z
SHA-256 of the archived text
822c07217a7ea1bf131c6e0552c86a7954074642e575887ad7b1f6c3bbf37a52
Stable URL of this page
https://metraipolis.com/documento/dc_cec05ead2576

How to cite

Detection coherence of tests — arXiv:2608.11177 — arXiv (en), https://arxiv.org/abs/2608.11177 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cec05ead2576 (Metraipolis archive dc_cec05ead2576, sha256 822c07217a7ea1bf131c6e0552c86a7954074642e575887ad7b1f6c3bbf37a52)
BibTeX
@misc{dccec05ead2576,
  title = {Detection coherence of tests — arXiv:2608.11177},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.11177},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cec05ead2576; sha256 822c07217a7ea1bf131c6e0552c86a7954074642e575887ad7b1f6c3bbf37a52},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.11177. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

There exist tests calibrated under a null narrower than the one implied by their test statistic -- the detection-null set. The part of the detection-null set not in the null is the test's blind spot. A framework for assessing detection coherence -- whether a test's blind spot is empty -- is introduced, built on new concepts of calibration statistic, detector, detection functional, detection-null set, and blind spot. It is demonstrated that the Wilcoxon--Mann--Whitney, Kruskal--Wallis, Friedman, and logrank tests are detection incoherent as unrestricted tests. Detection incoherent tests may become coherent under restrictions that make the blind spot empty, though domain restriction is not a reliable route to coherence in practice, since the boundary of the coherence-restoring domain is unknown and unverifiable. The Kolmogorov--Smirnov and Zaremba tests, and the Maximum Mean Discrepancy test with a characteristic kernel, are shown to be universally detection coherent. Due to the blind spot, a detection incoherent test misses discoveries when non-rejecting and yields spurious discoveries when rejecting, in both cases regardless of sample size. Detection incoherent tests should be abandoned.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-12 in stat.ME).
Categorie arXiv: Methodology (stat.ME).
Pagina del lavoro: https://arxiv.org/abs/2608.11177 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T06:16:10.996Z dalla pagina https://arxiv.org/catchup/stat.ME/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).