Metraipolis › archive › dc_12e6f8a1805e

Latent Spectral Prompting for Multimodal Hyperspectral Object Tracking — arXiv:2611.02512

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.02512
License (as archived)
CC0-1.0
Archived
2026-11-03T18:19:58.172Z
SHA-256 of the archived text
be26b37bb07009b1c54ba997bb7b6e674539dedc0f411e1263c9a823a0278473
Stable URL of this page
https://metraipolis.com/documento/dc_12e6f8a1805e

How to cite

Latent Spectral Prompting for Multimodal Hyperspectral Object Tracking — arXiv:2611.02512 — arXiv (en), https://arxiv.org/abs/2611.02512 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_12e6f8a1805e (Metraipolis archive dc_12e6f8a1805e, sha256 be26b37bb07009b1c54ba997bb7b6e674539dedc0f411e1263c9a823a0278473)
BibTeX
@misc{dc12e6f8a1805e,
  title = {Latent Spectral Prompting for Multimodal Hyperspectral Object Tracking — arXiv:2611.02512},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.02512},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_12e6f8a1805e; sha256 be26b37bb07009b1c54ba997bb7b6e674539dedc0f411e1263c9a823a0278473},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02512. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Hyperspectral videos provide rich spectral signatures for robust tracking under challenging conditions such as camouflage and low illumination. However, limited hyperspectral annotations and the large RGB-hyperspectral domain gap hinder the direct use of modern temporally pretrained RGB trackers. We propose SProTrack, a multimodal framework that transfers temporal knowledge from pretrained RGB trackers to the hyperspectral domain through latent spectral prompting. The key idea is to decouple temporal modeling from spectral adaptation, allowing temporal dynamics to be inherited from RGB foundation models while hyperspectral information is learned from unlabeled data in a self-supervised manner. Unlike band-selection methods that discard most spectral information or prompt-based approaches that rely on local-search crops, SProTrack learns a global, scene-level spectral representation from the full hyperspectral frame using an autoencoder. This latent representation is used to guide spectral prompt extraction while a pretrained RGB tracker preserves strong temporal modeling on RGB-compatible inputs. By encoding spectral-spatial structure into compact latent prompts, SProTrack bridges the RGB-hyperspectral modality gap without extensive retraining or dense supervision. Experiments on HOT2020 and HOT2023 demonstrate that SProTrack achieves the best overall performance, with strong results across all spectral domains.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.02512 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:09:53.689Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).