Metraipolis › archive › dc_44667229aad2

Balancing Representations by Identifying and Generating Under-represented Data — arXiv:2611.02952

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.02952
License (as archived)
CC0-1.0
Archived
2026-11-03T10:58:46.694Z
SHA-256 of the archived text
c576db00894f3b10eb48af337b9e9a60901fc83194d3403492750825f012dc7c
Stable URL of this page
https://metraipolis.com/documento/dc_44667229aad2

How to cite

Balancing Representations by Identifying and Generating Under-represented Data — arXiv:2611.02952 — arXiv (en), https://arxiv.org/abs/2611.02952 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_44667229aad2 (Metraipolis archive dc_44667229aad2, sha256 c576db00894f3b10eb48af337b9e9a60901fc83194d3403492750825f012dc7c)
BibTeX
@misc{dc44667229aad2,
  title = {Balancing Representations by Identifying and Generating Under-represented Data — arXiv:2611.02952},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.02952},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_44667229aad2; sha256 c576db00894f3b10eb48af337b9e9a60901fc83194d3403492750825f012dc7c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02952. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Self-supervised learning inherits the coverage of its source data. When an unlabeled corpus is long-tailed, the representation becomes dense around frequent modes and thin where coverage is weak. Objectives for long-tailed SSL reweight the images already in the corpus and add no new ones. We introduce BRIDGE (Balancing Representations by Identifying and Generating Under-represented Data), a label-free feedback loop around the source set. The current encoder scores every source image by its mean kNN distance, and a budgeted acquisition rule selects images from a band of that score distribution where support is thin and the generator still produces faithful variants. A frozen image-to-image diffusion model then adds local variants of the selected anchors, and pretraining continues on the enlarged source set. We formulate acquisition as recoverability-weighted allocation of local support and derive when a finite budget should favor a sparse band that excludes the extreme tail and when reallocation after each repair is optimal under a fixed objective. Across five long-tailed, web-scraped and synthetic source regimes, BRIDGE has the highest seven-task linear-probe and kNN average of the compared methods, and paired experiments extend the gain to ViT-S under contrastive and self-distillation objectives, to low-label fine-tuning and to semantic segmentation. The linear-probe gain is smaller under masked reconstruction. Generated repair matches an oracle that restores the withheld real images, and under a frozen encoder the inserted images shrink the neighborhoods of the selected anchors about twice as much as those of matched unselected images. BRIDGE needs no labels and leaves the pretraining objective unchanged, so it can be added to pretraining on uncurated web data, where the encoder decides which images to generate.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.02952 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:49:38.698Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).