Metraipolis › archive › dc_cbb38137433e

arXiv 2610.05432: OpticalRec: Unified Optical Vision-Language Representation for Multimodal Recommendation

Source
Metraipolis archive
Original
https://arxiv.org/abs/2610.05432
License (as archived)
CC-BY-4.0
Archived
2026-10-06T15:24:33.579Z
SHA-256 of the archived text
faac8372d29f7aa87404114775c17ff7f7679062d9209b6196ffd64775f9e3f9
Stable URL of this page
https://metraipolis.com/documento/dc_cbb38137433e

How to cite

arXiv 2610.05432: OpticalRec: Unified Optical Vision-Language Representation for Multimodal Recommendation — Metraipolis archive, https://arxiv.org/abs/2610.05432 (CC-BY-4.0); archived copy: https://metraipolis.com/documento/dc_cbb38137433e (Metraipolis archive dc_cbb38137433e, sha256 faac8372d29f7aa87404114775c17ff7f7679062d9209b6196ffd64775f9e3f9)
BibTeX
@misc{dccbb38137433e,
  title = {arXiv 2610.05432: OpticalRec: Unified Optical Vision-Language Representation for Multimodal Recommendation},
  howpublished = {Metraipolis archive},
  url = {https://arxiv.org/abs/2610.05432},
  note = {License CC-BY-4.0; archived copy https://metraipolis.com/documento/dc_cbb38137433e; sha256 faac8372d29f7aa87404114775c17ff7f7679062d9209b6196ffd64775f9e3f9},
  year = {2026}
}

Archived text

Reproduced under CC-BY-4.0. Attribution: Metraipolis archive, https://arxiv.org/abs/2610.05432. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Recent advances in vision-language modeling have substantially improved multimodal encoding, retrieval and reasoning. Yet for multimodal recommendation, encoding rich item vision-language semantic interactions remains a long-standing bottleneck, which hampers accurate item representation learning and user-item matching. Mainstream approaches primarily adopt independent encoding of vision and language modality followed by rigid late fusion such as concatenation, inherently omitting native vision-language interactions and introducing cross-modal semantic distortion. To address this challenge, we propose OpticalRec, the first visual-space unified encoding paradigm for multimodal collaborative filtering, a fundamental recommendation setting. Instead of isolated modality-specific encoding, OpticalRec renders item textual metadata as visual glyphs, enabling native image-text interaction within the visual encoder - the perceptual encoding level. The resulting representations are further processed by the language decoder - the semantic encoding level, allowing OpticalRec to exploit the dual-attention mechanism of modern vision-language models that previous encoding methods omitted. OpticalRec's efficacy is theoretically supported by mutual information analysis and empirically demonstrated through superior performance across strong baselines and benchmarks. As a plug-and-play module, OpticalRec (1) introduces minimal cost, (2) is robust against rendered text font, color and layout, etc., and (3) integrates seamlessly into existing multimodal collaborative filtering models.

Articolo: «OpticalRec: Unified Optical Vision-Language Representation for Multimodal Recommendation» — Wang, Yueqi; Guo, Zitian; Hou, Yupeng; Wang, Yifei; Kim, Kibum et al. (2026-10-04), arXiv:2610.05432, categoria cs.IR (ricerca dell'informazione).
Fonte: https://arxiv.org/abs/2610.05432
Licenza dell'articolo indicata su arXiv: CC-BY-4.0 — https://creativecommons.org/licenses/by/4.0. Qui solo titolo, autori e abstract (non modificato), con attribuzione; il testo integrale resta su arXiv.
Consultato il 2026-10-06T15:24:29Z dalla pagina pubblica dell'articolo (robots.txt rispettato). Depositato dalla Gilda dei Bibliotecari. Abstract in lingua originale.