Metraipolis › archive › dc_550802d3fcf6
SpecUltra: A Unified Foundation Model for Heterogeneous Spectral Images — arXiv:2611.01396
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.01396
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T18:53:24.603Z
- SHA-256 of the archived text
2621a66b90edc232fb04938532b6d7dbca2bfe26cb388ff585f0d64e0f5411c6- Stable URL of this page
https://metraipolis.com/documento/dc_550802d3fcf6
How to cite
SpecUltra: A Unified Foundation Model for Heterogeneous Spectral Images — arXiv:2611.01396 — arXiv (en), https://arxiv.org/abs/2611.01396 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_550802d3fcf6 (Metraipolis archive dc_550802d3fcf6, sha256 2621a66b90edc232fb04938532b6d7dbca2bfe26cb388ff585f0d64e0f5411c6)
BibTeX
@misc{dc550802d3fcf6,
title = {SpecUltra: A Unified Foundation Model for Heterogeneous Spectral Images — arXiv:2611.01396},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.01396},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_550802d3fcf6; sha256 2621a66b90edc232fb04938532b6d7dbca2bfe26cb388ff585f0d64e0f5411c6},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01396. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Spectral imagery, including hyperspectral image (HSI) and multispectral image (MSI), exhibits substantial heterogeneity in band numbers, wavelengths, spectral resolutions, hindering unified modeling and cross-sensor transfer. From the perspective of imaging physics, these heterogeneous observations can be regarded as discrete measurements of an underlying continuous spectrum acquired through different sampling processes. Motivated by this perspective, we propose SpecUltra, a unified foundation model for heterogeneous spectral images. Specifically, SpecUltra employs 3D convolutional tokenization and wavelength-aware 3D RoPE to encode relative wavelength and spatial relationships, enabling fine-grained spatial-spectral modeling within a shared coordinate system. We further construct MultiHyper-200K, a large-scale multi-sensor HSI dataset, and pretrain SpecUltra using auxiliary-token-assisted mask image modeling (MIM), where a level token indicates the radiometric product type and register tokens absorb sensor- and acquisition-dependent variations. To bridge the spectral-granularity gap between HSI and MSI, we introduce Spectral Kernel Transformation (SKT), which transfers pretrained knowledge in parameter space by constructing MSI embedding kernels from fine-grained HSI-pretrained kernel slices. This design preserves pretrained spectral priors while maintaining compatibility with the pretrained backbone. Experiments on HSI and MSI classification and segmentation benchmarks demonstrate state-of-the-art or competitive performance across disparate sensors and downstream tasks. Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2611.01396 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T18:16:52.925Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).