Metraipolis › archive › dc_159774cddecf

EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision — arXiv:2608.13014

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.13014
License (as archived)
CC0-1.0
Archived
2026-10-19T04:26:34.231Z
SHA-256 of the archived text
0aae4faa1be069dd082b370844370b387c72cc9d23007881c877e38242b571f2
Stable URL of this page
https://metraipolis.com/documento/dc_159774cddecf

How to cite

EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision — arXiv:2608.13014 — arXiv (en), https://arxiv.org/abs/2608.13014 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_159774cddecf (Metraipolis archive dc_159774cddecf, sha256 0aae4faa1be069dd082b370844370b387c72cc9d23007881c877e38242b571f2)
BibTeX
@misc{dc159774cddecf,
  title = {EgoPHI: Estimating 3D Hand-Object Contact and Force from Egocentric Vision — arXiv:2608.13014},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.13014},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_159774cddecf; sha256 0aae4faa1be069dd082b370844370b387c72cc9d23007881c877e38242b571f2},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.13014. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Understanding hand-object interaction from egocentric vision is essential for modeling how people physically engage with the surrounding world. Yet reasoning about physically grounded interaction requires estimating the forces acting on hands and objects, beyond localizing contact. We present EgoPHI, the first method that jointly estimates dense contact maps and 3D force distributions on hand and object meshes from a single monocular RGB image and object geometry. To address the lack of scalable ground-truth force annotations, we introduce a physics-based simulation pipeline that augments existing hand-object datasets with dense per-vertex force supervision. EgoPHI then learns dense 3D contact and force on interacting hand and articulated object meshes, extending vision-based force estimation beyond image-space or planar settings. Our evaluation on in-distribution and out-of-distribution benchmarks shows that EgoPHI improves force estimation over existing approaches while generalizing to unseen datasets. To evaluate sim-to-real transfer, we constructed two physical objects that capture dense object contact and force magnitude and used them to record a dataset of interactions from eight participants across diverse touch and grasp types. Our results demonstrate that EgoPHI recovers meaningful 3D contact and force distributions in simulated, out-of-distribution, and real-world settings, advancing egocentric hand-object understanding from contact localization toward physically grounded interaction reasoning.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-14 in cs.HC).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Graphics (cs.GR); Human-Computer Interaction (cs.HC); Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2608.13014 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T04:20:15.356Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-08-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).