Metraipolis › archive › dc_72cea630ae8a

W2A: Distilling World Priors into Action Models for Real-Time Robotic Control — arXiv:2611.02600

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.02600
License (as archived)
CC0-1.0
Archived
2026-11-03T18:57:17.521Z
SHA-256 of the archived text
b92455b0e4c7f4a2a3098d5291b6d948e43126efb70cd21f74f41f709e17fb53
Stable URL of this page
https://metraipolis.com/documento/dc_72cea630ae8a

How to cite

W2A: Distilling World Priors into Action Models for Real-Time Robotic Control — arXiv:2611.02600 — arXiv (en), https://arxiv.org/abs/2611.02600 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_72cea630ae8a (Metraipolis archive dc_72cea630ae8a, sha256 b92455b0e4c7f4a2a3098d5291b6d948e43126efb70cd21f74f41f709e17fb53)
BibTeX
@misc{dc72cea630ae8a,
  title = {W2A: Distilling World Priors into Action Models for Real-Time Robotic Control — arXiv:2611.02600},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.02600},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_72cea630ae8a; sha256 b92455b0e4c7f4a2a3098d5291b6d948e43126efb70cd21f74f41f709e17fb53},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02600. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

World Action Models (WAMs) have recently shown great promise in robotic control, benefiting from the future imagination capability of large-scale pretrained video models. However, most existing WAMs require explicitly imagining future states at test time, incurring substantial computational overhead and latency that make them unsuitable for real-time robotic control. In this paper, we propose W2A, a two-stage distillation framework for real-time robotic manipulation that distills intermediate denoising representations from a video diffusion model into an action model during training, while entirely discarding the video model at test time. We hypothesize that although video latent representations are high-dimensional, a compressed low-dimensional subspace is sufficient to provide effective supervision for action generation. This makes it possible to transfer such information effectively into an action model. Extensive experiments in both simulation and real-world settings demonstrate competitive success rates while significantly improving inference efficiency. On LIBERO, W2A achieves a 95.9% average success rate. More importantly, W2A achieves about 21x faster inference than the representative WAM baseline.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.RO, nuovi lavori del giorno).
Categorie arXiv: Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2611.02600 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:17:07.751Z dalla pagina https://arxiv.org/list/cs.RO/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).