Metraipolis › archive › dc_f3322f39145f
The GENEA Challenge 2026: A Large-Scale Disentangled Evaluation of Speech-Driven Gesture Generation on the Seamless Interaction Dataset — arXiv:2608.10839
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.10839
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:18:46.518Z
- SHA-256 of the archived text
76302b0b9e0acce13dd2bce7390ef66afcfa8961999b65ce6801de1d20b8c2d0- Stable URL of this page
https://metraipolis.com/documento/dc_f3322f39145f
How to cite
The GENEA Challenge 2026: A Large-Scale Disentangled Evaluation of Speech-Driven Gesture Generation on the Seamless Interaction Dataset — arXiv:2608.10839 — arXiv (en), https://arxiv.org/abs/2608.10839 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f3322f39145f (Metraipolis archive dc_f3322f39145f, sha256 76302b0b9e0acce13dd2bce7390ef66afcfa8961999b65ce6801de1d20b8c2d0)
BibTeX
@misc{dcf3322f39145f,
title = {The GENEA Challenge 2026: A Large-Scale Disentangled Evaluation of Speech-Driven Gesture Generation on the Seamless Interaction Dataset — arXiv:2608.10839},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.10839},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f3322f39145f; sha256 76302b0b9e0acce13dd2bce7390ef66afcfa8961999b65ce6801de1d20b8c2d0},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10839. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
This preprint presents the results of the fourth GENEA Challenge, a large-scale human evaluation of five speech-driven gesture-generation systems trained by participating teams on the Seamless Interaction dataset of dyadic conversations. As in the 2023 GENEA Challenge, we used a disentangled evaluation methodology to assess motion quality and speech alignment without confounding between the two, and performed a dyadic mismatching study to isolate the effect of listening and reacting to the interlocutor. We additionally introduce a new semantic gesture-generation task and a text-mismatching evaluation methodology using the Grounded Gestures subset of the data. In total, we ran four large-scale user studies, collecting over 23,000 votes from 869 test-takers. In the motion-realism study, the dataset's filtered segments had substantially higher motion quality than all challenge submissions (68-95% pairwise winrate). In the speech-alignment study, the motion-capture segments provided a conceptual ceiling at 62% alignment score, with the top submission significantly behind at 32% and the rest only slightly above the 0% expected of an input-independent system. In the dyadic study, motion capture again set the ceiling at 65% appropriateness score, but no submission scored substantially above chance, indicating that the systems could not yet respond to the interlocutor. Finally, the semantic mismatching evaluation found highly expressive gestures in the dataset (test-takers identified the matching transcript 79% of the time), yet almost all submissions failed to generate semantically expressive motion, with the best achieving only an 8% appropriateness score. The collected votes and outputs will be made publicly available at this https URL to facilitate reproducibility and further research. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-12 in cs.HC). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Graphics (cs.GR); Human-Computer Interaction (cs.HC); Sound (cs.SD). Pagina del lavoro: https://arxiv.org/abs/2608.10839 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T06:11:23.457Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).