Metraipolis › archive › dc_268a779b3744
Learning from Environmental Feedback: Credit Assignment across Multiple Timescales for Agentic Reinforcement Learning — arXiv:2608.08255
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.08255
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T08:50:46.480Z
- SHA-256 of the archived text
54b3be8fd1fbd81b92edca3286853465f49cbce6df58ac3df641c063ff814df9- Stable URL of this page
https://metraipolis.com/documento/dc_268a779b3744
How to cite
Learning from Environmental Feedback: Credit Assignment across Multiple Timescales for Agentic Reinforcement Learning — arXiv:2608.08255 — arXiv (en), https://arxiv.org/abs/2608.08255 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_268a779b3744 (Metraipolis archive dc_268a779b3744, sha256 54b3be8fd1fbd81b92edca3286853465f49cbce6df58ac3df641c063ff814df9)
BibTeX
@misc{dc268a779b3744,
title = {Learning from Environmental Feedback: Credit Assignment across Multiple Timescales for Agentic Reinforcement Learning — arXiv:2608.08255},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.08255},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_268a779b3744; sha256 54b3be8fd1fbd81b92edca3286853465f49cbce6df58ac3df641c063ff814df9},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.08255. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Agentic reinforcement learning (RL) often suffers from delayed and sparse rewards in real-world environments. A promising solution to this challenge is credit assignment, which aims to decompose trajectory-level rewards and provide more fine-grained supervision for intermediate decisions. However, existing credit assignment approaches ignore the rich process information naturally generated during environment interaction, e.g., interaction history. We argue that such information provides valuable supervision for identifying the contribution of individual actions. To this end, we propose Environmental Feedback-based Credit Assignment (EFCA), a multi-timescale credit assignment approach for long-horizon agentic RL. EFCA complements the long-term outcome signal with two environment-grounded process signals: a short-term feedback signal that captures the immediate effect of the current action and a medium-term state-history signal that identifies ineffective patterns from recent interactions. Both signals are directly extracted from environment feedback and integrated through a return reweighting mechanism. Experiments on ALFWorld and WebShop demonstrate that EFCA consistently improves both task success and task quality over strong baselines, highlighting the effectiveness of environment-grounded multi-timescale credit assignment for long-horizon agentic RL. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-11 in cs.CL). Categorie arXiv: Machine Learning (cs.LG) ; Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2608.08255 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T08:49:41.978Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).