Metraipolis › archive › dc_b8ea2efb2643
Multimodal Temporal Modeling for Continuous Group Emotion Recognition in Multi-party Dialogues — arXiv:2609.11164
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.11164
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T06:39:16.907Z
- SHA-256 of the archived text
f9c0e146b4052ce1119fa34f5c4466bc54bc7be670301f63aba913c6712b5fd9- Stable URL of this page
https://metraipolis.com/documento/dc_b8ea2efb2643
How to cite
Multimodal Temporal Modeling for Continuous Group Emotion Recognition in Multi-party Dialogues — arXiv:2609.11164 — arXiv (en), https://arxiv.org/abs/2609.11164 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b8ea2efb2643 (Metraipolis archive dc_b8ea2efb2643, sha256 f9c0e146b4052ce1119fa34f5c4466bc54bc7be670301f63aba913c6712b5fd9)
BibTeX
@misc{dcb8ea2efb2643,
title = {Multimodal Temporal Modeling for Continuous Group Emotion Recognition in Multi-party Dialogues — arXiv:2609.11164},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.11164},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b8ea2efb2643; sha256 f9c0e146b4052ce1119fa34f5c4466bc54bc7be670301f63aba913c6712b5fd9},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.11164. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
To realize natural behavior in dialogue agents in multi-party dialogue scenarios, it is important to understand group emotion such as valence and arousal as a whole. Most prior work addressed this task at the utterance level or using a coarse-grained time window, which is not sufficient to capture emotional dynamics. In this study, we formulate continuous recognition of the Group Emotion at a one-second resolution. Moreover, we also introduce the Mixed state, which captures the emotional divergence among participants in the group. We constructed a dataset with frame-level soft labels based on the TEIDAN corpus and propose a multimodal temporal framework that integrates audio and video information using a sliding-window context. Experimental results demonstrate that the temporal Transformer outperforms simple baselines and shows stronger temporal agreement with the ground-truth labels than the LLM-based model. The effect of context length is limited, whereas audio-visual input outperforms either unimodal input on the continuous-label metrics. Additionally, our analysis shows larger Group Emotion recognition errors in intervals with high Mixed values, exposing emotional divergence as a key challenge for group emotion recognition. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-11 in cs.MM). Categorie arXiv: Multimedia (cs.MM). Pagina del lavoro: https://arxiv.org/abs/2609.11164 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T06:16:25.620Z dalla pagina https://arxiv.org/catchup/cs.MM/2026-09-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).