Metraipolis › archive › dc_4aa46fec55b8

WorldLine: Action-Driven Visual Simulation for Robotic Manipulation — arXiv:2609.38059

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.38059
License (as archived)
CC0-1.0
Archived
2026-10-07T18:42:10.991Z
SHA-256 of the archived text
32f9d91cd40b0b16e4017a9fab361ad57d5749b180ebd7c83ceda0720c647063
Stable URL of this page
https://metraipolis.com/documento/dc_4aa46fec55b8

How to cite

WorldLine: Action-Driven Visual Simulation for Robotic Manipulation — arXiv:2609.38059 — arXiv (en), https://arxiv.org/abs/2609.38059 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4aa46fec55b8 (Metraipolis archive dc_4aa46fec55b8, sha256 32f9d91cd40b0b16e4017a9fab361ad57d5749b180ebd7c83ceda0720c647063)
BibTeX
@misc{dc4aa46fec55b8,
  title = {WorldLine: Action-Driven Visual Simulation for Robotic Manipulation — arXiv:2609.38059},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.38059},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4aa46fec55b8; sha256 32f9d91cd40b0b16e4017a9fab361ad57d5749b180ebd7c83ceda0720c647063},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.38059. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Real-world robot learning is constrained by the cost of collecting experience and evaluating candidate behaviors. Video generation models offer a scalable foundation for visual simulators that predict action outcomes before physical execution. Yet they often favor visual plausibility over accurate action following and coherent robot--object dynamics, while action-conditioned simulators depend on scarce, embodiment-specific data that are difficult to share across incompatible control spaces. We introduce WorldLine, an action-driven visual simulator that decouples transferable dynamics learning from heterogeneous action grounding. WorldLine learns manipulation dynamics from more than 10,000 hours of action-free robot videos and grounds them using over 2,000 hours of action trajectories across more than ten embodiments. An image-space action representation provides a shared control interface across embodiments, while multi-view and failure-enriched training with relational regularization improves interaction-sensitive prediction. Robot-focused few-step distillation enables efficient causal rollout while preserving action-critical motion. Across held-out and out-of-domain settings, WorldLine maintains strong visual quality and robot-motion agreement; on failed trajectories, it improves robot-mask IoU by 0.1626 over the strongest baseline. It predicts trajectory success with 74% mean accuracy across RoboTwin and AgiBot, one percentage point above the strongest baseline. Without RoboTwin training or adaptation, its rollouts improve task success by up to 21.4 percentage points over direct policy execution. Together, these capabilities make WorldLine a scalable and efficient visual simulator for policy evaluation and embodied planning. More results are available at \href{ this https URL }{project page}.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-30 in cs.CV).
Categorie arXiv: Robotics (cs.RO) ; Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.38059 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T18:04:24.986Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).