Metraipolis › archive › dc_ebeb58ceeb8c

Interactive World Simulation with Cosmos for Physical AI — arXiv:2611.06627

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.06627
License (as archived)
CC0-1.0
Archived
2026-11-05T18:17:08.979Z
SHA-256 of the archived text
fec8916755ab41cf855cd7ea72bc997cc4fade888a9f668351648fdc8be07330
Stable URL of this page
https://metraipolis.com/documento/dc_ebeb58ceeb8c

How to cite

Interactive World Simulation with Cosmos for Physical AI — arXiv:2611.06627 — arXiv (en), https://arxiv.org/abs/2611.06627 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ebeb58ceeb8c (Metraipolis archive dc_ebeb58ceeb8c, sha256 fec8916755ab41cf855cd7ea72bc997cc4fade888a9f668351648fdc8be07330)
BibTeX
@misc{dcebeb58ceeb8c,
  title = {Interactive World Simulation with Cosmos for Physical AI — arXiv:2611.06627},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.06627},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ebeb58ceeb8c; sha256 fec8916755ab41cf855cd7ea72bc997cc4fade888a9f668351648fdc8be07330},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06627. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We present a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the framework enables users and embodied agents to interact with evolving virtual environments. It supports both predicting the visual consequences of actions and generating observations from physical state maintained by an external simulator. We demonstrate this approach across camera navigation and robot manipulation, controllable video transfer, and multi-view autonomous vehicle (AV) simulation. These examples provide a shared foundation for developing interactive virtual environments for Physical AI training and evaluation. Our code and model checkpoints are available at this https URL and this https URL . The project website is available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2611.06627 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-05T18:12:49.016Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).