Metraipolis › archive › dc_3d486405b920

TactoHand: Learning Geometry-Based Dense Hand-Surface Interaction Fields from Video — arXiv:2610.39585

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.39585
License (as archived)
CC0-1.0
Archived
2026-11-01T02:42:03.213Z
SHA-256 of the archived text
ef0a30e4cc35746903fc6827a9ddd1093a63d1abfe1c47483f6898e94b136889
Stable URL of this page
https://metraipolis.com/documento/dc_3d486405b920

How to cite

TactoHand: Learning Geometry-Based Dense Hand-Surface Interaction Fields from Video — arXiv:2610.39585 — arXiv (en), https://arxiv.org/abs/2610.39585 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3d486405b920 (Metraipolis archive dc_3d486405b920, sha256 ef0a30e4cc35746903fc6827a9ddd1093a63d1abfe1c47483f6898e94b136889)
BibTeX
@misc{dc3d486405b920,
  title = {TactoHand: Learning Geometry-Based Dense Hand-Surface Interaction Fields from Video — arXiv:2610.39585},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.39585},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3d486405b920; sha256 ef0a30e4cc35746903fc6827a9ddd1093a63d1abfe1c47483f6898e94b136889},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.39585. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Understanding how humans interact with the world requires a representation of physical interactions at the hand surface. Tactile sensing captures these interactions, but collecting tactile data at scale requires specialized hardware. We introduce TactoHand, a model that predicts three dense hand-surface interaction fields---contact, proximity, and 3D force---from monocular video. We derive geometry-based contact and proximity labels and motion-derived force labels from eligible training data within a curated collection spanning approximately 50 million source frames. TactoHand uses a temporal transformer to aggregate visual evidence across frames, while three learned queries decode the corresponding hand-surface fields. A differentiable physics layer further constrains force predictions using observed object motion. Across in-domain and out-of-domain benchmarks, TactoHand improves contact and proximity estimation over prior methods. In addition, physics supervision reduces position and rotation errors in motion rollouts, and the predicted contact and proximity fields improve downstream hand-object reconstruction. Together, these results show a scalable, low-cost path to learning hand-surface interaction fields without collecting tactile measurements. Code will be released at this https URL .

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2610.39585 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-01T02:16:43.938Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).