Metraipolis › archive › dc_989490c84430
emg2face: Expressive Facial Animation with High-Density Surface EMG — arXiv:2610.09304
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.09304
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T12:36:49.086Z
- SHA-256 of the archived text
3f198dc3e6247af5e1a732bd6607275c83b5668dd2799cc759dee35f205df591- Stable URL of this page
https://metraipolis.com/documento/dc_989490c84430
How to cite
emg2face: Expressive Facial Animation with High-Density Surface EMG — arXiv:2610.09304 — arXiv (en), https://arxiv.org/abs/2610.09304 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_989490c84430 (Metraipolis archive dc_989490c84430, sha256 3f198dc3e6247af5e1a732bd6607275c83b5668dd2799cc759dee35f205df591)
BibTeX
@misc{dc989490c84430,
title = {emg2face: Expressive Facial Animation with High-Density Surface EMG — arXiv:2610.09304},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.09304},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_989490c84430; sha256 3f198dc3e6247af5e1a732bd6607275c83b5668dd2799cc759dee35f205df591},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.09304. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Facial movements convey subtle and important information that is critical for human social communication. Optical methods for face capture are difficult or impossible to use when the face is occluded by head-mounted devices (HMDs), such as VR headsets. Even with a clear line of sight, such methods raise privacy concerns and require head-mounted capture rigs that offset cameras and lighting from the face. We show that high-density surface electromyography (HD-sEMG) provides a viable non-optical alternative that addresses these challenges. We measured 64 EMG channels, using two textile EMG grids, with 32 from the forehead (typically occluded by an HMD) and 32 from the side of the face. EMG data were digitized at 2048 Hz and filtered. Facial movements were simultaneously recorded and used to estimate 478 3D facial landmarks using MediaPipe's Face Landmarker. A major challenge in such multimodal recordings is synchronizing EMG and video data, which have different sampling frequencies and independent clocks. We developed a novel synchronization method using analog audio bursts that is capable of sub-millisecond synchronization. We also developed a staged fitting method that fits a recent high-resolution parametric head model (GNM), with 253 identity blendshapes and 383 expression blendshapes, to the MediaPipe landmarks as participants performed different facial expressions. We trained a deep neural network comprising per-grid spatial encoders followed by a dilated temporal convolutional network (TCN) to predict blendshape parameters from HD-sEMG signals at 100 Hz. Once trained, the network can predict expression blendshapes solely from HD-sEMG recordings. The output can be rendered using standard real-time blendshape animation methods. We demonstrate the methods using recordings from 25 participants, and direct expression transfer to a variety of human faces and non-human characters. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno). Categorie arXiv: Graphics (cs.GR) ; Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2610.09304 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T12:14:15.386Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).