Metraipolis › archive › dc_bbe402843cdb

TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds — arXiv:2611.06061

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.06061
License (as archived)
CC0-1.0
Archived
2026-11-05T18:17:43.248Z
SHA-256 of the archived text
f6ec0511a5eb9a8611834f0ad1f18b9b83bb2b04d714b0c3196c2d02a64cb99d
Stable URL of this page
https://metraipolis.com/documento/dc_bbe402843cdb

How to cite

TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds — arXiv:2611.06061 — arXiv (en), https://arxiv.org/abs/2611.06061 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_bbe402843cdb (Metraipolis archive dc_bbe402843cdb, sha256 f6ec0511a5eb9a8611834f0ad1f18b9b83bb2b04d714b0c3196c2d02a64cb99d)
BibTeX
@misc{dcbbe402843cdb,
  title = {TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds — arXiv:2611.06061},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.06061},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_bbe402843cdb; sha256 f6ec0511a5eb9a8611834f0ad1f18b9b83bb2b04d714b0c3196c2d02a64cb99d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06061. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Recent video world models allow users to explore generated environments through camera navigation. Continuous hand motion provides a fine-grained action channel for interacting with the people and objects encountered during exploration. We present TouchéWorld, a framework that integrates gesture-driven interaction into a camera-controlled video world model. Given an initial image and a scene-description prompt, the model generates video conditioned on temporally aligned camera and hand controls. We construct joint camera--hand training data from heterogeneous egocentric videos through annotation completion, consistency-based filtering, and temporal alignment. Building on a pretrained camera-controlled world model, we combine spatial hand-skeleton conditioning with numerical hand-motion features through parameter-efficient adaptation. Causal adaptation and few-step distillation support chunk-level online generation, allowing users to update their controls based on generated visual feedback. We further introduce TouchéBench to evaluate hand-motion following, camera--hand coordination, online interaction, and object response. Together, these components establish a framework for studying continuous exploration and hand-driven interaction within generative worlds.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.06061 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-05T18:12:49.045Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).