Metraipolis › archive › dc_e0c5679aceaa
Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening — arXiv:2608.11748
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.11748
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T05:49:28.601Z
- SHA-256 of the archived text
64f6526f430646029d4db7b6e298899380c56eaf358cb2cc601b8ae57adacc49- Stable URL of this page
https://metraipolis.com/documento/dc_e0c5679aceaa
How to cite
Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening — arXiv:2608.11748 — arXiv (en), https://arxiv.org/abs/2608.11748 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e0c5679aceaa (Metraipolis archive dc_e0c5679aceaa, sha256 64f6526f430646029d4db7b6e298899380c56eaf358cb2cc601b8ae57adacc49)
BibTeX
@misc{dce0c5679aceaa,
title = {Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening — arXiv:2608.11748},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.11748},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e0c5679aceaa; sha256 64f6526f430646029d4db7b6e298899380c56eaf358cb2cc601b8ae57adacc49},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.11748. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Hyperspectral pansharpening aims to reconstruct a high resolution hyperspectral (HRHS) image from a panchromatic (PAN) image and a low resolution hyperspectral (LRHS) image while preserving both spatial details and spectral fidelity. Recent diffusion based methods exploit pretrained image priors by generating a low dimensional representation and subsequently mapping it to the hyperspectral domain. However, the observed panchromatic and hyperspectral images are typically imposed only through external reconstruction objectives, limiting their direct interaction with the diffusion prior. To address this issue, we propose dual-modality image-prompted diffusion model (DIDM) for zero shot hyperspectral pansharpening. DIDM encodes the low resolution hyperspectral and panchromatic observations into spectral and spatial prompt tokens, respectively, and injects them into intermediate features of a frozen remote sensing diffusion model through cross attention, allowing complementary spectral and spatial information to directly guide diffusion feature evolution. In addition, we introduce a panchromatic guided weighted pixel aware total variation regularizer that combines low resolution hyperspectral degradation fidelity and panchromatic response fidelity with gradient adaptive structural regularization, thereby preserving structural discontinuities while suppressing spurious variations in homogeneous regions. Extensive experiments on Pavia, Chikusei, and Houston under reduced resolution protocols show that DIDM achieves the best performance across all evaluated metrics, while full resolution evaluation on FR1 yields the highest HQNR among the compared methods. These results demonstrate that internal dual modality prompting and panchromatic guided structural regularization provide an effective balance between spatial detail enhancement and spectral preservation. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-13 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2608.11748 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T05:42:25.882Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-08-13?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).