Metraipolis › archive › dc_6838fe74be12

Beyond Argmax: A Mechanistic Study of Semantic Retention in Frozen Foundation-Model Composition for Generalized Few-Shot 3D Segmentation — arXiv:2609.12099

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.12099
License (as archived)
CC0-1.0
Archived
2026-10-16T03:57:29.551Z
SHA-256 of the archived text
ae3835bc4e7a7628bd295d89a004637b144a4f14fc2eeed416fc93d99cdb2e29
Stable URL of this page
https://metraipolis.com/documento/dc_6838fe74be12

How to cite

Beyond Argmax: A Mechanistic Study of Semantic Retention in Frozen Foundation-Model Composition for Generalized Few-Shot 3D Segmentation — arXiv:2609.12099 — arXiv (en), https://arxiv.org/abs/2609.12099 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6838fe74be12 (Metraipolis archive dc_6838fe74be12, sha256 ae3835bc4e7a7628bd295d89a004637b144a4f14fc2eeed416fc93d99cdb2e29)
BibTeX
@misc{dc6838fe74be12,
  title = {Beyond Argmax: A Mechanistic Study of Semantic Retention in Frozen Foundation-Model Composition for Generalized Few-Shot 3D Segmentation — arXiv:2609.12099},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.12099},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6838fe74be12; sha256 ae3835bc4e7a7628bd295d89a004637b144a4f14fc2eeed416fc93d99cdb2e29},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.12099. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Classical classifier-combination work distinguishes score-level fusion from hard decision-level voting. We revisit this distinction where independently pretrained, frozen foundation models are composed at inference time for generalized few-shot 3D segmentation. We ask: how much useful semantic information is lost when heterogeneous sources are collapsed to a single class before they can interact? We answer with a same-input semantic-retention intervention. Dense RegionPLC and sparse cross-view SAM3 evidence, model weights, masks, geometry, vocabularies, and fusion rules are frozen; only the number of semantic alternatives retained before interaction is varied via a matched top-k ladder. On 156 held-out ScanNet200 scenes, top-1 reaches 28.47 harmonic-mean (HM) IoU while full distribution fusion reaches 34.87 HM (+6.40, 95% CI [+5.24,+7.64]). The pattern replicates on 50 ScanNet++ scenes: 23.02 vs. 26.50 HM (+3.48, 95% CI [+1.64,+5.93]). The conclusion is robust: full-distribution HM is stable across sparse-source weights 0.3--0.7; alternative operators (max, geometric pooling) also outperform top-1; and a GroundingDINO--SAM2.1 source-replacement diagnostic shows monotonic HM increase from 14.77 to 18.75 with full retention. Calibration diagnostics reveal opposite miscalibration of the two sources, yet correcting calibration does not eliminate the retention advantage. Across datasets and source stacks, most information is recovered by retaining a compact set of plausible alternatives. The contribution is a controlled diagnosis of premature semantic collapse as a repeatable information bottleneck in heterogeneous frozen-model composition.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-14 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.12099 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T03:44:26.220Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).