Metraipolis › archive › dc_febaefa45b56
Hard Cases, Bad Labels: Testing Error Exposure and Error Location in Uncertainty Sampling Under Bounded Label Noise — arXiv:2608.13601
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.13601
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T02:30:23.366Z
- SHA-256 of the archived text
d17aa9b8d15654a26bef27d608ca2c331f7a3a739069346e6ee881ab4f045883- Stable URL of this page
https://metraipolis.com/documento/dc_febaefa45b56
How to cite
Hard Cases, Bad Labels: Testing Error Exposure and Error Location in Uncertainty Sampling Under Bounded Label Noise — arXiv:2608.13601 — arXiv (en), https://arxiv.org/abs/2608.13601 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_febaefa45b56 (Metraipolis archive dc_febaefa45b56, sha256 d17aa9b8d15654a26bef27d608ca2c331f7a3a739069346e6ee881ab4f045883)
BibTeX
@misc{dcfebaefa45b56,
title = {Hard Cases, Bad Labels: Testing Error Exposure and Error Location in Uncertainty Sampling Under Bounded Label Noise — arXiv:2608.13601},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.13601},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_febaefa45b56; sha256 d17aa9b8d15654a26bef27d608ca2c331f7a3a739069346e6ee881ab4f045883},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.13601. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Active learning can reduce labeling cost by selecting informative examples, but the most uncertain examples may also be the hardest to label correctly. This study tests whether uncertainty sampling fails because it acquires more corrupted labels or because errors concentrated in difficult regions are especially harmful. Margin-based uncertainty sampling is compared with random sampling under clean labels, random classification noise (RCN), and bounded difficulty-dependent noise on three public binary tabular datasets. The design uses 100 paired seeds, nine expected noise rates from 0 to 0.30, annotation budgets from 20 to 120, and logistic regression with regularization re-selected by cross-validation at every budget. An exposure-matched RCN control aligns mean final acquired corruption, while a clean-label extension reaches budget 400. Under clean labels, uncertainty sampling improved normalized balanced-accuracy area under the learning curve by 1.09 to 1.77 percentage points on all datasets. Difficulty-dependent noise reduced this advantage more than RCN at six of eight rates on Breast Cancer Wisconsin, but at no tested rate on Banknote Authentication or MAGIC Gamma Telescope. Exposure-matched analyses found no corrected evidence for a universal additional penalty from structured error location. On clean MAGIC data, uncertainty sampling improved balanced accuracy while reducing average precision and true-positive rate at fixed false-positive rates. Thus, uncertainty sampling was label-efficient, but its apparent robustness depended on dataset, budget, noise structure, and evaluation metric. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-17 in cs.LG). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.13601 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T02:26:17.767Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).