Metraipolis › archive › dc_f0b15839fa69
World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation — arXiv:2609.01067
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.01067
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T07:10:05.606Z
- SHA-256 of the archived text
f4b7c215a0c17635742c0400a9285cb5fc7237ef1425f440c1cbd84314f4ee87- Stable URL of this page
https://metraipolis.com/documento/dc_f0b15839fa69
How to cite
World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation — arXiv:2609.01067 — arXiv (en), https://arxiv.org/abs/2609.01067 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f0b15839fa69 (Metraipolis archive dc_f0b15839fa69, sha256 f4b7c215a0c17635742c0400a9285cb5fc7237ef1425f440c1cbd84314f4ee87)
BibTeX
@misc{dcf0b15839fa69,
title = {World Model-Guided Reinforcement Learning via Counterfactual User Engagement Simulation — arXiv:2609.01067},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.01067},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f0b15839fa69; sha256 f4b7c215a0c17635742c0400a9285cb5fc7237ef1425f440c1cbd84314f4ee87},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.01067. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Reinforcement learning for user-centric agents is limited by the cost, latency, and risk of collecting online feedback, as well as by the lack of counterfactual comparisons under the same user state. In this paper, we propose World Model-Guided Reinforcement Learning via counterfactual user engagement simulation (WMG-RL), a framework in which a frozen user simulator provides reward supervision before real user exposure. Motivated by language world models, we instantiate the simulator as a User Engagement World Model (UEWM), which treats a recommended item as the agent action and the user's heterogeneous feedback as the environment observation. Rather than learning one fixed environment transition, UEWM learns to infer user-specific dynamics from engagement history and apply them to candidate items. In WMG-RL, a downstream policy proposes multiple candidate items for the same history; UEWM predicts the corresponding engagement feedback in parallel; and the simulated feedback is converted into dense rewards for policy optimization. Experiments show that UEWM provides reliable and transferable reward signals across domains, and that WMG-RL enables a compact 1.7B student policy to match or surpass much larger LLMs on downstream recommendation tasks. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-02 in cs.IR). Categorie arXiv: Information Retrieval (cs.IR). Pagina del lavoro: https://arxiv.org/abs/2609.01067 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T07:00:39.712Z dalla pagina https://arxiv.org/catchup/cs.IR/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).