Metraipolis › archive › dc_7b96ac37ea2f

Geometry-Preserving Human-to-Robot Upper-Body Motion Retargeting from Monocular Video — arXiv:2609.37776

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.37776
License (as archived)
CC0-1.0
Archived
2026-10-07T19:15:46.199Z
SHA-256 of the archived text
6e24d2e35c3ad849c0d67f06726d8098bac198862889e7003e325f76f99a167d
Stable URL of this page
https://metraipolis.com/documento/dc_7b96ac37ea2f

How to cite

Geometry-Preserving Human-to-Robot Upper-Body Motion Retargeting from Monocular Video — arXiv:2609.37776 — arXiv (en), https://arxiv.org/abs/2609.37776 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7b96ac37ea2f (Metraipolis archive dc_7b96ac37ea2f, sha256 6e24d2e35c3ad849c0d67f06726d8098bac198862889e7003e325f76f99a167d)
BibTeX
@misc{dc7b96ac37ea2f,
  title = {Geometry-Preserving Human-to-Robot Upper-Body Motion Retargeting from Monocular Video — arXiv:2609.37776},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.37776},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7b96ac37ea2f; sha256 6e24d2e35c3ad849c0d67f06726d8098bac198862889e7003e325f76f99a167d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.37776. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Monocular RGB video provides an accessible source of human demonstrations for upper-body robot motion, yet video-driven human-to-robot transfer remains challenging because body and hand motion are recovered at different spatial scales, human and robot kinematics differ substantially, and fine distal motion is difficult to preserve across embodiments. We present a geometry-preserving motion-retargeting framework that integrates unified body--hand reconstruction with morphology-independent geometric transfer. Frame-wise body estimates, video-level observations, and detailed hand evidence jointly constrain a single differentiable Momentum Human Rig (MHR) state, while transient hand artifacts are repaired in parameter space. The reconstructed motion is represented by arm-segment directions, elbow configuration, relative palm orientation, and bilateral wrist relations, and is realized on the target robot through multi-stage inverse kinematics and robot-specific hand adaptation. Within the broader system, Across-VAM provides video generation, whereas Across-WAM performs human-to-robot motion mapping. The method is evaluated on 16 monocular videos comprising 1,769 source frames, including 10 signing and six reach-to-grasp sequences. Unified reconstruction reduces mean hand reprojection error from 22.36 to 7.21 pixels relative to SAM 3D Body. All 16 retargeted trajectories completed kinematic simulation playback, and representative signing and reach-to-grasp motions were further demonstrated on a physical robot. The results demonstrate a unified pipeline from monocular human video to coordinated upper-body motion on a dual-arm dexterous robot.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-30 in cs.RO).
Categorie arXiv: Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.37776 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T18:40:59.540Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).