Metraipolis › archive › dc_84bca281a117

SSR-GRPO: Integrating Supervision and Semantic IDs into Reinforcement Learning for Dense Retrieval in E-commerce — arXiv:2608.19595

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.19595
License (as archived)
CC0-1.0
Archived
2026-10-18T12:03:28.584Z
SHA-256 of the archived text
1ce80327098af3e93f0e11be718b3c7b4d104a98b7144321294e548757391c56
Stable URL of this page
https://metraipolis.com/documento/dc_84bca281a117

How to cite

SSR-GRPO: Integrating Supervision and Semantic IDs into Reinforcement Learning for Dense Retrieval in E-commerce — arXiv:2608.19595 — arXiv (en), https://arxiv.org/abs/2608.19595 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_84bca281a117 (Metraipolis archive dc_84bca281a117, sha256 1ce80327098af3e93f0e11be718b3c7b4d104a98b7144321294e548757391c56)
BibTeX
@misc{dc84bca281a117,
  title = {SSR-GRPO: Integrating Supervision and Semantic IDs into Reinforcement Learning for Dense Retrieval in E-commerce — arXiv:2608.19595},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.19595},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_84bca281a117; sha256 1ce80327098af3e93f0e11be718b3c7b4d104a98b7144321294e548757391c56},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.19595. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Embedding-based retrieval (EBR) is pivotal in e-commerce search but often struggles with complex semantics. While recent methods often fine-tune large language models (LLMs) for representation learning, they typically lack robust mechanisms for handling complex and implicit semantics. While Retrieval-GRPO (R-GRPO) recently introduced reinforcement learning to dense retrieval, it suffers from noisy top-K candidates due to limited batch sampling and biased relevance assessments caused by using similarly trained LLMs as reward models. To tackle these issues, we propose Supervised Retrieval-GRPO with Semantic Identifiers (SSR-GRPO). Specifically, our method first proposes a dual-perspective framework for relevance assessment. It leverages both Semantic Identifiers (SIDs) produced by quantization learning and dense representation vectors to generate more unbiased relevance scores. Furthermore, leveraging the hierarchical similarity relationships of the generated SIDs, we mine a set of hard negative samples that serve two purposes: (1) to design a masking function integrated into R-GRPO, effectively filtering intra-group noisy samples; and (2) to construct a Retrieval-DPO task composed of positive and negative sample pairs, enabling the model to capture fine-grained semantic distinctions from a pair-wise perspective. By integrating these optimization strategies, we propose SSR-GRPO. Extensive offline and online experiments validate SSR-GRPO's effectiveness, and it has been deployed on a large-scale e-commerce platform.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-21 in cs.IR).
Categorie arXiv: Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2608.19595 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T12:01:23.928Z dalla pagina https://arxiv.org/catchup/cs.IR/2026-08-21?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).