Metraipolis › archive › dc_c3c6aa8a63c2

LACS: Distribution-Sensitive Label-Agnostic Confidence Selection for Dynamic Data Pruning — arXiv:2611.05616

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.05616
License (as archived)
CC0-1.0
Archived
2026-11-05T18:21:58.606Z
SHA-256 of the archived text
14e4e294733d1eb5fe79bee93f87720f9d01445ad915042067816679ff667433
Stable URL of this page
https://metraipolis.com/documento/dc_c3c6aa8a63c2

How to cite

LACS: Distribution-Sensitive Label-Agnostic Confidence Selection for Dynamic Data Pruning — arXiv:2611.05616 — arXiv (en), https://arxiv.org/abs/2611.05616 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c3c6aa8a63c2 (Metraipolis archive dc_c3c6aa8a63c2, sha256 14e4e294733d1eb5fe79bee93f87720f9d01445ad915042067816679ff667433)
BibTeX
@misc{dcc3c6aa8a63c2,
  title = {LACS: Distribution-Sensitive Label-Agnostic Confidence Selection for Dynamic Data Pruning — arXiv:2611.05616},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.05616},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c3c6aa8a63c2; sha256 14e4e294733d1eb5fe79bee93f87720f9d01445ad915042067816679ff667433},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.05616. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Training on large datasets motivates selecting which examples receive expensive training computation. Fixed quotas determine the amount of pruning in advance, while absolute confidence cutoffs depend on the score scale. We study a population-relative alternative that adapts the threshold and retained count together. We introduce LACS (Label-Agnostic Confidence Selector), a training-time rule based on maximum predictive confidence, requiring neither labels at selection time nor per-example gradients. LACS removes examples at or above a log-mean-exp reference plus a margin. We characterize its sensitivity to score gaps and mass, and derive an exact no-pruning condition. For $0<\rho<1$, the removed fraction is at most $\rho$ and at least one example remains. The unsigned score permits both confidently correct and confidently wrong examples to be removed. Seven evaluation settings include neural training, language modeling, and boosting. Neural execution studies reduce backward-active rows by 10-35%; on CIFAR-10, 29% fewer backward rows accompany accuracy means of 89.77% versus 89.82% for full CE. At a matched backward budget and number of optimizer updates, LACS is 1.0 pp above small-batch training and 1.2 pp above random selection over five seeds. Across 14 tabular datasets, quadratic boosting reduces mean test error from 23.36% to 22.96%. Its full training replays use about 30% fewer fitting rows; these counters span a different horizon from validation-selected accuracy. In one RBF-SVM case study, elapsed time falls by 37% with slightly lower error. These findings separate selective-work reduction from realized acceleration: the current exact-current-score neural implementation uses an additional scoring forward, so its backward sparsity does not yet translate into wall-clock acceleration. This overhead is an execution choice rather than a requirement of the selection rule.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.05616 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-05T18:15:49.002Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).