Metraipolis › archive › dc_1fa46ffd150e

FaceSnap: Real-Time Personalized Lightstage Facial Performance Capture — arXiv:2608.31033

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.31033
License (as archived)
CC0-1.0
Archived
2026-10-17T09:59:48.097Z
SHA-256 of the archived text
22ed209fc94fb8d40b0d5b693b4f2c91aa098059f62470ba441f96211aca5af2
Stable URL of this page
https://metraipolis.com/documento/dc_1fa46ffd150e

How to cite

FaceSnap: Real-Time Personalized Lightstage Facial Performance Capture — arXiv:2608.31033 — arXiv (en), https://arxiv.org/abs/2608.31033 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_1fa46ffd150e (Metraipolis archive dc_1fa46ffd150e, sha256 22ed209fc94fb8d40b0d5b693b4f2c91aa098059f62470ba441f96211aca5af2)
BibTeX
@misc{dc1fa46ffd150e,
  title = {FaceSnap: Real-Time Personalized Lightstage Facial Performance Capture — arXiv:2608.31033},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.31033},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_1fa46ffd150e; sha256 22ed209fc94fb8d40b0d5b693b4f2c91aa098059f62470ba441f96211aca5af2},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.31033. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Lightstage facial capture produces production-quality digital humans, but it is resource and labor-intensive. Multi-camera setups, hours of computation, and massive data storage create bottlenecks that hinder iterative workflows. This paper introduces FaceSnap, an end-to-end framework that streamlines capture via a two-stage approach. First, a one-time multi-view optimization from a range-of-motion sequence builds a personalized model encoding both geometry and expression-dependent appearance. This model then enables high-fidelity real-time facial performance capture from a single monocular lightstage camera, with no further multi-view capture required. FaceSnap jointly estimates geometry and dynamic 4K texture at 83 fps. The 4K texture is produced by a novel personalized residual upscaler that recovers subject-specific high-frequency detail, which generic upscalers fail to capture. FaceSnap achieves geometric accuracy competitive with full per-frame multi-view optimization while outperforming feed-forward methods trained on production-quality 3D data, all from a single camera view. Finally, we introduce Multi4D, a public benchmark for evaluating 4D facial reconstruction methods in lightstage environments, enabling topology-invariant geometric comparison across methods.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-01 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2608.31033 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T09:28:48.214Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).