Metraipolis › archive › dc_93a8a8de325c
MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision — arXiv:2609.04958
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.04958
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T23:41:16.767Z
- SHA-256 of the archived text
2bdefe6931e5bca40c834e5c185bc7a7eb14d4b20407c802851ba22502d23cfc- Stable URL of this page
https://metraipolis.com/documento/dc_93a8a8de325c
How to cite
MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision — arXiv:2609.04958 — arXiv (en), https://arxiv.org/abs/2609.04958 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_93a8a8de325c (Metraipolis archive dc_93a8a8de325c, sha256 2bdefe6931e5bca40c834e5c185bc7a7eb14d4b20407c802851ba22502d23cfc)
BibTeX
@misc{dc93a8a8de325c,
title = {MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision — arXiv:2609.04958},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.04958},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_93a8a8de325c; sha256 2bdefe6931e5bca40c834e5c185bc7a7eb14d4b20407c802851ba22502d23cfc},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.04958. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Recovering camera and hand motion in world coordinates from egocentric video is a key capability for activity understanding, robot learning, and augmented reality. Existing systems typically decompose this problem into separate stages for camera motion, depth estimation, hand reconstruction, and trajectory refinement, resulting in substantial computational overhead and preventing the joint modeling of camera and hand motion. We introduce MINT (Minting IN-the-Wild Trajectories), a foundation model for world-space hand motion reconstruction from ego-centric RGB video. From a single shared spatiotemporal video representation, MINT jointly predicts the camera trajectory, field of view (FoV), camera-frame hand states, and per-frame hand observability, and then produces world-space hand motion via explicit coordinate transformations. Training such a model at scale is challenging, since paired world-space camera and hand annotations are scarce. We therefore develop an open-source labeling EGOPIPELINE that converts large collections of public egocentric videos into structured camera-and-hand trajectory supervision. MINT is first pretrained on these large-scale pseudo-labels and then fine-tuned on a small set of high-quality camera-and-hand annotations. Across public benchmarks MINT approaches state-of-the-art accuracy without seeing either benchmark in training, reaching 0.945 frame accuracy, 13.646 mm PA-MPJPE-p and 55.058 px EPE-p for camera-frame bimanual reconstruction on HOT3D, 4.690 mm RPE-T and 0.284 degrees RPE-R for camera trajectory, and a 3.67x end-to-end speedup over the labeling pipeline that supervises it. We release the model, training and inference code, labeling pipeline, and a curated 1,021-hour egocentric trajectory dataset. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-07 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Robotics (cs.RO). Pagina del lavoro: https://arxiv.org/abs/2609.04958 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T23:16:11.425Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).