Metraipolis › archive › dc_795991661709
Exploiting Target Knowledge from MLLMs for Robust Few-Shot Segmentation — arXiv:2609.28949
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.28949
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T06:44:18.423Z
- SHA-256 of the archived text
7ac259b5e6d3b7e218e922006736e6fb5ba5f344def10fdc02eea03329e04506- Stable URL of this page
https://metraipolis.com/documento/dc_795991661709
How to cite
Exploiting Target Knowledge from MLLMs for Robust Few-Shot Segmentation — arXiv:2609.28949 — arXiv (en), https://arxiv.org/abs/2609.28949 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_795991661709 (Metraipolis archive dc_795991661709, sha256 7ac259b5e6d3b7e218e922006736e6fb5ba5f344def10fdc02eea03329e04506)
BibTeX
@misc{dc795991661709,
title = {Exploiting Target Knowledge from MLLMs for Robust Few-Shot Segmentation — arXiv:2609.28949},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.28949},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_795991661709; sha256 7ac259b5e6d3b7e218e922006736e6fb5ba5f344def10fdc02eea03329e04506},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.28949. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Few-shot segmentation (FSS) aims to segment unseen object categories with a few (e.g., one or five) labeled examples, enabling efficient adaptation to novel classes. Conventional models typically rely on appearance-based visual matching between support and query images for segmentation. While straightforward, these methods often struggle to handle significant appearance discrepancies and occlusions in the query image due to insufficient target knowledge. To mitigate this, we introduce a novel framework that mines target knowledge using the strong reasoning capacity of Multimodal Large Language Models (MLLMs) and employs it to enhance FSS. Specifically, building on SAM 2, our method, named MK-FSS, exploits two forms of complementary knowledge derived from a query image by an MLLM for FSS, including spatial knowledge, which provides a spatial prior indicating the potential target location, and semantic knowledge, which describes the target using text. The spatial knowledge is first encoded into a memory representation, and then resulting memory is integrated with the support-guided memory feature from query image through a carefully designed dual-memory debate-fusion (DMDF) module, yielding a more robust target memory feature. In parallel, the semantic knowledge is encoded into the textual feature, which is fused with multi-scale query features via a progressive cross-modal prompt generator (PCPG), producing a target-aware multimodal prompt for segmentation. Working together, the dual-memory feature and the multimodal prompt provide a comprehensive representation of the target, enabling more robust segmentation. In our extensive experiments, MK-FSS shows promising results and largely surpasses existing methods. Code will be released. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-25 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2609.28949 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T06:09:29.798Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).