Metraipolis › archive › dc_cd4fb10e1c42

Beyond Ranking Accuracy: Evaluating LLM-Cited Feature Rationales for Next Basket Repurchase Recommendation — arXiv:2608.30333

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.30333
License (as archived)
CC0-1.0
Archived
2026-10-17T07:52:36.866Z
SHA-256 of the archived text
80fa7cb05075da353e29dbc9bb62c85d0bfd8608f44c2cdd60ffd596b78247dd
Stable URL of this page
https://metraipolis.com/documento/dc_cd4fb10e1c42

How to cite

Beyond Ranking Accuracy: Evaluating LLM-Cited Feature Rationales for Next Basket Repurchase Recommendation — arXiv:2608.30333 — arXiv (en), https://arxiv.org/abs/2608.30333 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cd4fb10e1c42 (Metraipolis archive dc_cd4fb10e1c42, sha256 80fa7cb05075da353e29dbc9bb62c85d0bfd8608f44c2cdd60ffd596b78247dd)
BibTeX
@misc{dccd4fb10e1c42,
  title = {Beyond Ranking Accuracy: Evaluating LLM-Cited Feature Rationales for Next Basket Repurchase Recommendation — arXiv:2608.30333},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.30333},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cd4fb10e1c42; sha256 80fa7cb05075da353e29dbc9bb62c85d0bfd8608f44c2cdd60ffd596b78247dd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.30333. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Next-basket repurchase recommendation is commonly formulated as a ranking task: given a customer's purchase history, the system ranks previously purchased items that may be needed again. In production settings, however, ranking accuracy is only one component of recommendation quality. Customers may also benefit from concise evidence about why an item is recommended now. Large language models (LLMs) offer a potential way to surface such evidence through feature-based, human-readable rationales grounded in interpretable behavioral signals. We construct repurchase features spanning cadence, frequency, recency, user behavior, and item popularity, and evaluate LLMs on two public grocery datasets and one proprietary retail dataset. We investigate (1) whether off-the-shelf LLMs can use these features as next-basket scorers relative to heuristic and supervised rankers, and (2) whether LLM-cited features carry outcome-grounded ranking signal. For the latter, we compare LLM-cited features with model-specific attribution methods under a cross-model feature-masking protocol that measures ranking degradation after masking selected features. Our results show that LLM scores are not competitive with supervised rankers, suggesting that off-the-shelf LLMs should not be used as standalone repurchase recommenders. However, changes in prompt and evidence representation can improve outcome-grounded feature-masking results in some settings even when ranking performance does not improve; the effect is dataset-dependent and does not consistently match attribution baselines. These findings suggest a practical role for LLMs as validated explanation components rather than primary rankers, with rationale quality evaluated separately from ranking accuracy.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.AI).
Categorie arXiv: Information Retrieval (cs.IR) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.30333 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T07:28:26.858Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).