Metraipolis › archive › dc_66978719cdca
MV-Sign: Multi-View 3D Motion Integration and Enhanced Text-to-Motion Conditioning for Sign Language Production — arXiv:2611.07811
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.07811
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-06T14:53:34.593Z
- SHA-256 of the archived text
78eb1c35df6c0aee83a595330341053dfdaa2d5c6758239a992577ed2ae17cc8- Stable URL of this page
https://metraipolis.com/documento/dc_66978719cdca
How to cite
MV-Sign: Multi-View 3D Motion Integration and Enhanced Text-to-Motion Conditioning for Sign Language Production — arXiv:2611.07811 — arXiv (en), https://arxiv.org/abs/2611.07811 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_66978719cdca (Metraipolis archive dc_66978719cdca, sha256 78eb1c35df6c0aee83a595330341053dfdaa2d5c6758239a992577ed2ae17cc8)
BibTeX
@misc{dc66978719cdca,
title = {MV-Sign: Multi-View 3D Motion Integration and Enhanced Text-to-Motion Conditioning for Sign Language Production — arXiv:2611.07811},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.07811},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_66978719cdca; sha256 78eb1c35df6c0aee83a595330341053dfdaa2d5c6758239a992577ed2ae17cc8},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.07811. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Sign language production (SLP) aims to generate appropriate sign language motion from spoken language text. However, current 3D SLP methods suffer from noisy supervision and weak text conditioning. Specifically, these methods typically rely on pseudo-3D motion data fitted from single-view frontal videos, which introduces severe self-occlusion and loses fine-grained hand details, ultimately degrading downstream production. To overcome these limitations, we propose a comprehensive framework that jointly integrates multi-view 3D motion data and optimizes the text-conditioning pathway. First, we introduce How2Sign-MV3D, a high-fidelity dataset constructed via a novel cross-view curation pipeline that fuses multi-view estimates to resolve occlusions and filter non-signing segments. Second, we design a robust SLP model incorporating a sign-aware spatio-temporal VQ-VAE (ST-VQVAE) for joint body-hand tokenization, a pseudo-gloss adapter, and keyframe-aware retrieval to enhance text-to-motion alignment. Evaluated on the How2Sign benchmark, our framework reduces body and hand DTW-PA-JPE by 32.8% and 20.9% respectively compared to the state-of-the-art. Finally, we release two new high-quality 3D datasets, ASLCitizen-3D and MM-WAuslan-MV3D, alongside SGNify-MV as a multi-view video benchmark to support broader community research. Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2611.07811 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-06T14:25:42.619Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).