Metraipolis › archive › dc_d096701aaef2
ReuScope: Auditing Data Reuse and Evaluation Sensitivity in Capsule Vision 2024 — arXiv:2610.41835
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.41835
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-02T07:09:34.743Z
- SHA-256 of the archived text
9a3c39dfb0cf37d07b490449f13f05b8a2d8b80bd389a63efc9e412aa390608e- Stable URL of this page
https://metraipolis.com/documento/dc_d096701aaef2
How to cite
ReuScope: Auditing Data Reuse and Evaluation Sensitivity in Capsule Vision 2024 — arXiv:2610.41835 — arXiv (en), https://arxiv.org/abs/2610.41835 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d096701aaef2 (Metraipolis archive dc_d096701aaef2, sha256 9a3c39dfb0cf37d07b490449f13f05b8a2d8b80bd389a63efc9e412aa390608e)
BibTeX
@misc{dcd096701aaef2,
title = {ReuScope: Auditing Data Reuse and Evaluation Sensitivity in Capsule Vision 2024 — arXiv:2610.41835},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.41835},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d096701aaef2; sha256 9a3c39dfb0cf37d07b490449f13f05b8a2d8b80bd389a63efc9e412aa390608e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.41835. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
We develop ReuScope, a protocol for auditing data reuse and evaluation sensitivity, using Capsule Vision 2024 as a case study. It combines measurements of data relationships with two comparisons: changing the evaluation population while holding predictions fixed, and changing training data while holding evaluation fixed. Byte-identical files cross the public training-validation boundary, and all 41 Kvasir-Capsule recordings that contribute frames occur in both partitions. Shared source recordings establish cross-split overlap; missing cross-recording patient identifiers prevent counting unique shared patients. Across ten paired seeds, removing all training rows attributed to Kvasir-Capsule, plus five rows from other sources flagged as near-matches to it, lowers public-validation balanced accuracy from 82.5% to 61.2%. Evaluating the same fitted models on the validation rows of the other sources reverses the comparison: removal improves balanced accuracy by 1.38 percentage points. The public-validation drop measures sensitivity to source removal, not an amount of leakage-induced inflation. Matched controls show that sample size and class counts alone do not explain the observed score differences. An exploratory experiment removes the training neighbors of validation frames that have close training matches, or equally many distant training rows, and yields a difference-in-differences estimate, relative to matched unflagged frames, of -0.355 percentage points in true-class probability; the paired-t interval for accuracy spans zero. The resulting procedure distinguishes observed reuse from conditional performance sensitivity and specifies the population, class support and uncertainty unit for each conclusion. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2610.41835 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-02T07:06:59.367Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).