Metraipolis › archive › dc_bbe402843cdb
TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds — arXiv:2611.06061
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.06061
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-05T18:17:43.248Z
- SHA-256 of the archived text
f6ec0511a5eb9a8611834f0ad1f18b9b83bb2b04d714b0c3196c2d02a64cb99d- Stable URL of this page
https://metraipolis.com/documento/dc_bbe402843cdb
How to cite
TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds — arXiv:2611.06061 — arXiv (en), https://arxiv.org/abs/2611.06061 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_bbe402843cdb (Metraipolis archive dc_bbe402843cdb, sha256 f6ec0511a5eb9a8611834f0ad1f18b9b83bb2b04d714b0c3196c2d02a64cb99d)
BibTeX
@misc{dcbbe402843cdb,
title = {TouchéWorld tech report : Towards Online Unified Camera--Hand Exploration in Generative Worlds — arXiv:2611.06061},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.06061},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_bbe402843cdb; sha256 f6ec0511a5eb9a8611834f0ad1f18b9b83bb2b04d714b0c3196c2d02a64cb99d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06061. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Recent video world models allow users to explore generated environments through camera navigation. Continuous hand motion provides a fine-grained action channel for interacting with the people and objects encountered during exploration. We present TouchéWorld, a framework that integrates gesture-driven interaction into a camera-controlled video world model. Given an initial image and a scene-description prompt, the model generates video conditioned on temporally aligned camera and hand controls. We construct joint camera--hand training data from heterogeneous egocentric videos through annotation completion, consistency-based filtering, and temporal alignment. Building on a pretrained camera-controlled world model, we combine spatial hand-skeleton conditioning with numerical hand-motion features through parameter-efficient adaptation. Causal adaptation and few-step distillation support chunk-level online generation, allowing users to update their controls based on generated visual feedback. We further introduce TouchéBench to evaluate hand-motion following, camera--hand coordination, online interaction, and object response. Together, these components establish a framework for studying continuous exploration and hand-driven interaction within generative worlds. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.06061 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-05T18:12:49.045Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).