Metraipolis › archive › dc_ffe92c37cbb9

EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation — arXiv:2610.06970

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.06970
License (as archived)
CC0-1.0
Archived
2026-10-07T11:39:32.985Z
SHA-256 of the archived text
03ff26e767653005f995e5c0fdaaab2fd09afc4c4dcf5710eb9ee76a1e169334
Stable URL of this page
https://metraipolis.com/documento/dc_ffe92c37cbb9

How to cite

EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation — arXiv:2610.06970 — arXiv (en), https://arxiv.org/abs/2610.06970 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ffe92c37cbb9 (Metraipolis archive dc_ffe92c37cbb9, sha256 03ff26e767653005f995e5c0fdaaab2fd09afc4c4dcf5710eb9ee76a1e169334)
BibTeX
@misc{dcffe92c37cbb9,
  title = {EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation — arXiv:2610.06970},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.06970},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ffe92c37cbb9; sha256 03ff26e767653005f995e5c0fdaaab2fd09afc4c4dcf5710eb9ee76a1e169334},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.06970. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Egocentric bimanual hand pose estimation is important for virtual interaction, wearable control, and rehabilitation, but visual observations are often degraded by self-occlusion, hand-hand contact, and object manipulation. We propose EVFormer, a multimodal framework that combines the current RGB frame with the preceding 200 ms of bilateral wrist surface electromyography (sEMG) to estimate 44 finger and wrist joint angles. EVFormer separately encodes visual spatial features and sEMG temporal features, enables cross-modal information exchange through sequential bidirectional cross-attention, and integrates the two modalities using feature-wise gated fusion. We evaluate EVFormer in a single-participant feasibility study using one synchronized public EgoEMG recording with chronologically separated training, validation, and test splits. On 296 test samples, EVFormer achieves a mean absolute error of 11.482 degrees, compared with 13.228-13.610 degrees for vision-only, sEMG-only, late-fusion, and training-mean baselines. This corresponds to relative error reductions of 13.20% compared with the vision-only model and 14.23% compared with late fusion. EVFormer also achieves the lowest error in four of the five evaluated gesture classes. These results provide preliminary evidence that feature-level interaction between egocentric vision and sEMG can improve bimanual hand pose estimation. Further evaluation across participants, recording sessions, sensor placements, and real-world interaction conditions is required to establish the generalizability of the approach.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.HC, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2610.06970 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T11:19:09.650Z dalla pagina https://arxiv.org/list/cs.HC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).