Metraipolis › archive › dc_159774cddecf
EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision — arXiv:2608.13014
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.13014
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T04:26:34.231Z
- SHA-256 of the archived text
0aae4faa1be069dd082b370844370b387c72cc9d23007881c877e38242b571f2- Stable URL of this page
https://metraipolis.com/documento/dc_159774cddecf
How to cite
EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision — arXiv:2608.13014 — arXiv (en), https://arxiv.org/abs/2608.13014 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_159774cddecf (Metraipolis archive dc_159774cddecf, sha256 0aae4faa1be069dd082b370844370b387c72cc9d23007881c877e38242b571f2)
BibTeX
@misc{dc159774cddecf,
title = {EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision — arXiv:2608.13014},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.13014},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_159774cddecf; sha256 0aae4faa1be069dd082b370844370b387c72cc9d23007881c877e38242b571f2},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.13014. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding hand-object interaction from egocentric vision is essential for modeling how people physically engage with the surrounding world. Yet reasoning about physically grounded interaction requires estimating the forces acting on hands and objects, beyond localizing contact. We present EgoPHI, the first method that jointly estimates dense contact maps and 3D force distributions on hand and object meshes from a single monocular RGB image and object geometry. To address the lack of scalable ground-truth force annotations, we introduce a physics-based simulation pipeline that augments existing hand-object datasets with dense per-vertex force supervision. EgoPHI then learns dense 3D contact and force on interacting hand and articulated object meshes, extending vision-based force estimation beyond image-space or planar settings. Our evaluation on in-distribution and out-of-distribution benchmarks shows that EgoPHI improves force estimation over existing approaches while generalizing to unseen datasets. To evaluate sim-to-real transfer, we constructed two physical objects that capture dense object contact and force magnitude and used them to record a dataset of interactions from eight participants across diverse touch and grasp types. Our results demonstrate that EgoPHI recovers meaningful 3D contact and force distributions in simulated, out-of-distribution, and real-world settings, advancing egocentric hand-object understanding from contact localization toward physically grounded interaction reasoning. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-14 in cs.HC). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Graphics (cs.GR); Human-Computer Interaction (cs.HC); Robotics (cs.RO). Pagina del lavoro: https://arxiv.org/abs/2608.13014 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T04:20:15.356Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-08-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).