Metraipolis › archive › dc_f07165318cee
TouchSight: Bare-Handed Tactile Prediction from Egocentric Video via Generative Visual Augmentation — arXiv:2609.20414
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.20414
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-10T03:24:17.042Z
- SHA-256 of the archived text
fe71d454d4e993c42eacdffa344105b734e647cf080b2ef6a40261617965de80- Stable URL of this page
https://metraipolis.com/documento/dc_f07165318cee
How to cite
TouchSight: Bare-Handed Tactile Prediction from Egocentric Video via Generative Visual Augmentation — arXiv:2609.20414 — arXiv (en), https://arxiv.org/abs/2609.20414 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f07165318cee (Metraipolis archive dc_f07165318cee, sha256 fe71d454d4e993c42eacdffa344105b734e647cf080b2ef6a40261617965de80)
BibTeX
@misc{dcf07165318cee,
title = {TouchSight: Bare-Handed Tactile Prediction from Egocentric Video via Generative Visual Augmentation — arXiv:2609.20414},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.20414},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f07165318cee; sha256 fe71d454d4e993c42eacdffa344105b734e647cf080b2ef6a40261617965de80},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.20414. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Tactile signals provide direct contact and force measurements that are essential for understanding physical interactions and enabling dexterous robotic manipulation. However, tactile sensing requires direct measurement at contact interfaces, making large-scale data collection reliant on intrusive, costly, and restrictive instrumentation. We present TouchSight, a monocular egocentric vision framework for dense full-hand contact force prediction that leverages 500 hours of pressure-glove recordings and extensive hand-object interaction (HOI) data. To address the appearance gap between gloved training data and bare-hand real-world scenarios, we construct TwinTouch-20H: 20 hours of paired visual data in which generative video models re-render gloved recordings as bare-hand observations against new backgrounds while preserving the original measured tactile labels. TouchSight predicts dense force from both gloved and generated bare-hand videos, outperforms prior contact prediction methods on OakInk2, qualitatively generalizes to natural bare-hand egocentric videos from unseen datasets, and improves consistently as glove supervision scales. These results demonstrate that dense tactile signals can be recovered from egocentric vision alone, without tactile instrumentation at capture time. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-18 in cs.AI). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.20414 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-10T03:04:13.951Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).