Metraipolis › archive › dc_11acc2b6abdc
Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval — arXiv:2608.12570
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.12570
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T04:55:15.872Z
- SHA-256 of the archived text
49e517e0f53867c4d1b7448bc93de1d43804f5975f24f763e7520b0c81e6261f- Stable URL of this page
https://metraipolis.com/documento/dc_11acc2b6abdc
How to cite
Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval — arXiv:2608.12570 — arXiv (en), https://arxiv.org/abs/2608.12570 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_11acc2b6abdc (Metraipolis archive dc_11acc2b6abdc, sha256 49e517e0f53867c4d1b7448bc93de1d43804f5975f24f763e7520b0c81e6261f)
BibTeX
@misc{dc11acc2b6abdc,
title = {Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval — arXiv:2608.12570},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.12570},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_11acc2b6abdc; sha256 49e517e0f53867c4d1b7448bc93de1d43804f5975f24f763e7520b0c81e6261f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.12570. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Fashion retrieval often requires satisfying multiple attributes at once, such as category, color, pattern, and demographic. Monolithic embeddings mix these signals into a single vector, making attribute-specific control difficult at retrieval time. Many existing semantic-ID methods provide discrete item codes, but these codes are typically optimized as item-level or residual addresses and do not expose named, independently controllable attribute slots. We introduce MM-slotgate, a multimodal slot encoder that factorizes Fashion-CLIP text and image embeddings into four named attribute slots. Each slot learns its own text-image gate, so visually grounded attributes such as color and pattern can rely more on image evidence, while taxonomy-oriented attributes such as category and demographic can remain more text-driven. On H&M, using a combined slot-similarity and slot-logit retrieval score, MM-slotgate achieves 0.7566 macro ConstraintSatisfied@10, outperforming equal-weight multimodal fusion (0.7142) and fCLIP text-only retrieval (0.4755). The largest gain is on color, which improves from 0.321 to 0.889 (+0.568 absolute), as the learned color gate assigns 57.4% weight to image evidence. The learned gates are interpretable without modality supervision: color is image-leaning, category is text-leaning, and pattern and demographic lie near the middle. The resulting slots also remain controllable: linear probes show no measured excess leakage beyond the label-correlation baseline, and quantized slot codes support targeted intervention, including a 15.3x lift for color. These results suggest that controllable fashion retrieval benefits from typed, attribute-conditioned multimodal slots rather than either a single global embedding or opaque item-level semantic IDs. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-14 in cs.IR). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Information Retrieval (cs.IR). Pagina del lavoro: https://arxiv.org/abs/2608.12570 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T04:46:09.760Z dalla pagina https://arxiv.org/catchup/cs.IR/2026-08-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).