Metraipolis › archive › dc_d372225c02bb
Exploiting Textual Semantics for Robust Cross-View Object Correspondence — arXiv:2611.02356
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.02356
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T10:48:16.994Z
- SHA-256 of the archived text
82a2260845fc2c313f12095ba563cdb4637a86e7349df84186c4cdb384be412a- Stable URL of this page
https://metraipolis.com/documento/dc_d372225c02bb
How to cite
Exploiting Textual Semantics for Robust Cross-View Object Correspondence — arXiv:2611.02356 — arXiv (en), https://arxiv.org/abs/2611.02356 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d372225c02bb (Metraipolis archive dc_d372225c02bb, sha256 82a2260845fc2c313f12095ba563cdb4637a86e7349df84186c4cdb384be412a)
BibTeX
@misc{dcd372225c02bb,
title = {Exploiting Textual Semantics for Robust Cross-View Object Correspondence — arXiv:2611.02356},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.02356},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d372225c02bb; sha256 82a2260845fc2c313f12095ba563cdb4637a86e7349df84186c4cdb384be412a},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02356. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Cross-view object correspondence (CVOC) aims to establish associations of the same target between query and search videos captured from different viewpoints. Existing methods often rely on visual cues for CVOC. Despite recent progress, these methods struggle in complicated scenarios with substantial viewpoint changes and appearance variations, due to lacking sufficient target information. Addressing this, we introduce TeSCo, a framework that exploits rich Textual Semantics of an object, in addition to its visual cues, for cross-view object Correspondence. Our key insight is, textual description of a target, by capturing diverse attributes such as category, texture, and color, provides viewpoint- and appearance-invariant semantics, which are complementary to visual cues and can hence enhance correspondence robustness in complicated scenes. Inspired by this, TeSCo first generates a textual expression of the target from the given query view using a vision-language model, and then extracts textual feature to enhance visual features for localization in the search view. To realize this, we introduce a text-conditioned cross-modal fusion (TCF) module that incorporates the textual feature into visual features with text-guided modulation, producing more robust multimodal target representation for object correspondence. Since not all textual cues are equally compatible with the target in current search-view frame, we propose an iterative textual feature refinement (ITFR) module that progressively adjusts textual feature using search-view information before the TCF module, enabling search-view-aware textual semantics to be fused into visual features and leading to better performance. In extensive experiments on Ego-Exo4D and HANDAL-X, TeSCo demonstrates state-of-the-art results and largely outperforms other models, validating its efficacy. Our code is released at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.02356 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T10:39:50.561Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).