Metraipolis › archive › dc_677809f08376

Humanoid World Action Model With Joint State--Action Generation — arXiv:2610.12026

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.12026
License (as archived)
CC0-1.0
Archived
2026-10-09T06:03:28.823Z
SHA-256 of the archived text
c576cdc62313b8af33ba1743fa92f2f21d48174acb67ccb5656fc69c7b120d15
Stable URL of this page
https://metraipolis.com/documento/dc_677809f08376

How to cite

Humanoid World Action Model With Joint State--Action Generation — arXiv:2610.12026 — arXiv (en), https://arxiv.org/abs/2610.12026 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_677809f08376 (Metraipolis archive dc_677809f08376, sha256 c576cdc62313b8af33ba1743fa92f2f21d48174acb67ccb5656fc69c7b120d15)
BibTeX
@misc{dc677809f08376,
  title = {Humanoid World Action Model With Joint State--Action Generation — arXiv:2610.12026},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.12026},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_677809f08376; sha256 c576cdc62313b8af33ba1743fa92f2f21d48174acb67ccb5656fc69c7b120d15},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.12026. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Humanoid robots are a promising platform for general-purpose manipulation. Recent Vision-Language-Action (VLA) policies learn actions directly from multimodal observations, while World Action Models (WAMs) further incorporate future visual prediction to improve action generation. However, in hierarchical humanoid systems, VLA and WAM policies output reference actions that are subsequently realized through whole-body control, robot dynamics, balance, and contact. This hierarchy creates an action--execution gap: the reference produced by the policy can differ from the motion realized by the robot. Without explicitly modeling the realized body state, future visual prediction must jointly explain scene evolution and discrepancies between reference actions and executed motion, making it difficult to associate an action with its physical outcome. We propose HWAM, a Humanoid World Action Model with joint state--action generation, which makes the robot's post-execution proprioceptive state an explicit prediction target. By jointly generating reference actions and their realized body states, HWAM directly incorporates supervision of executed motion into action learning. HWAM is trained through three complementary conditional paths. The Policy path jointly denoises state--action trajectories conditioned only on current observations, matching deployment conditions. Forward Dynamics Modeling (FDM) predicts future visual observations conditioned on actions and post-execution states, while Inverse Dynamics Modeling (IDM) reconstructs the joint trajectory from visual transitions. Together, these paths connect policy references, realized body motion, and visual outcomes. HWAM achieves the highest success rate among evaluated baselines on three real-robot tasks on the LimX OLI humanoid. On Candy Picking, HWAM achieves a 70.6% success rate, compared with 43.3% for Fast-WAM.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.12026 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T05:47:02.003Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).