Metraipolis › archive › dc_8329352eade0
EgoMo3R: Joint Egocentric Motion and Scene Reconstruction — arXiv:2611.01627
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.01627
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T18:18:04.692Z
- SHA-256 of the archived text
650b995a9e40d69550838f67675a132dffd90bfb0a2db0c272068789af408406- Stable URL of this page
https://metraipolis.com/documento/dc_8329352eade0
How to cite
EgoMo3R: Joint Egocentric Motion and Scene Reconstruction — arXiv:2611.01627 — arXiv (en), https://arxiv.org/abs/2611.01627 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8329352eade0 (Metraipolis archive dc_8329352eade0, sha256 650b995a9e40d69550838f67675a132dffd90bfb0a2db0c272068789af408406)
BibTeX
@misc{dc8329352eade0,
title = {EgoMo3R: Joint Egocentric Motion and Scene Reconstruction — arXiv:2611.01627},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.01627},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8329352eade0; sha256 650b995a9e40d69550838f67675a132dffd90bfb0a2db0c272068789af408406},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01627. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding holistic 3D human motion and the surrounding environment from egocentric video is fundamental for applications in AR/VR and robotics. Although these tasks are inherently coupled, existing methods treat them separately. In particular, egocentric motion reconstruction methods typically assume access to metric, gravity-aligned camera trajectories from specialized inertial sensors. Recovering such trajectories from monocular egocentric video remains a significant challenge due to rapid head movements and motion blur. We present EgoMo3R, a joint optimization framework that simultaneously reconstructs 3D human motion and scene geometry from casual egocentric video. It leverages the robustness of low-level visuo-geometric primitives, including monocular depth, optical flow, and point tracks, integrated with a diffusion-based human motion prior via first-order optimization. We propose an alternating optimization scheme that establishes a synergistic feedback loop: scene reconstruction provides physical grounding and trajectory conditioning for the motion prior, while the motion prior regularizes the camera trajectory and anchors the scene in a metric, gravity-aligned world frame. We evaluate EgoMo3R on the highly dynamic sequences of the EgoExo4D and Nymeria datasets and show that it outperforms specialized baselines in both 3D scene reconstruction and egocentric motion estimation. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.01627 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T18:09:53.611Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).