Metraipolis › archive › dc_dfafb7eae9a9
Memory as Plans: World-Action Modeling with Memory-Grounded Planning — arXiv:2609.11561
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.11561
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T06:36:02.776Z
- SHA-256 of the archived text
85299eebb60340469183c3baf43e20fdda7fe5df1b57cedb0b596004ef1fd67b- Stable URL of this page
https://metraipolis.com/documento/dc_dfafb7eae9a9
How to cite
Memory as Plans: World-Action Modeling with Memory-Grounded Planning — arXiv:2609.11561 — arXiv (en), https://arxiv.org/abs/2609.11561 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_dfafb7eae9a9 (Metraipolis archive dc_dfafb7eae9a9, sha256 85299eebb60340469183c3baf43e20fdda7fe5df1b57cedb0b596004ef1fd67b)
BibTeX
@misc{dcdfafb7eae9a9,
title = {Memory as Plans: World-Action Modeling with Memory-Grounded Planning — arXiv:2609.11561},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.11561},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_dfafb7eae9a9; sha256 85299eebb60340469183c3baf43e20fdda7fe5df1b57cedb0b596004ef1fd67b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.11561. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Mainstream robotic policies often adopt a Markovian formulation, but many complex real-world manipulation tasks are inherently non-Markovian, requiring long-horizon memory beyond the current observation. Existing memory mechanisms often rely on language summaries, growing visual windows, or their combinations, and may therefore lose fine-grained visual evidence or face a trade-off between history coverage and execution efficiency. We introduce MaP-WAM, a Memory-as-Plans framework that decomposes memory-dependent world-action modeling into memory-grounded planning and plan-conditioned execution, and uses long-term multimodal episodic context as planning-time evidence rather than repeatedly conditioning the executor on the full history. MaP-WAM represents memory as completed segment records containing language instructions and sparse visual context, and converts this episodic memory into compact plans comprising the next segment-level language plan and corresponding visual guidance. A World-Action-Progress (WAP) model executes each plan over an unknown duration by jointly predicting action chunks and corresponding execution progress at inference time, calibrating predicted progress through plan-observation alignment for adaptive segment transitions and closed-loop context updates. MaP-WAM keeps the executor context length fixed, while structured attention further enables key-value caching in both planning and execution. MaP-WAM achieves state-of-the-art performance on RMBench with an 83.3% success rate and attains 78.0% success on real-robot tasks, while maintaining approximately constant executor inference latency as task history grows. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-11 in cs.RO). Categorie arXiv: Robotics (cs.RO). Pagina del lavoro: https://arxiv.org/abs/2609.11561 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T06:10:18.234Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).