Metraipolis › archive › dc_7e22fedd7f37

E$^3$mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment — arXiv:2608.10796

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.10796
License (as archived)
CC0-1.0
Archived
2026-10-19T06:30:28.676Z
SHA-256 of the archived text
08180a1bc16b38c9cf74bda03a07e4d00dfbca447257cc540f5a58cb648da9ce
Stable URL of this page
https://metraipolis.com/documento/dc_7e22fedd7f37

How to cite

E$^3$mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment — arXiv:2608.10796 — arXiv (en), https://arxiv.org/abs/2608.10796 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7e22fedd7f37 (Metraipolis archive dc_7e22fedd7f37, sha256 08180a1bc16b38c9cf74bda03a07e4d00dfbca447257cc540f5a58cb648da9ce)
BibTeX
@misc{dc7e22fedd7f37,
  title = {E$^3$mo-Bench: A Scalable Benchmark for Multimodal Evoked and Expressed Emotion Understanding via Bayesian Pairwise Alignment — arXiv:2608.10796},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.10796},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7e22fedd7f37; sha256 08180a1bc16b38c9cf74bda03a07e4d00dfbca447257cc540f5a58cb648da9ce},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10796. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Understanding both expressed and evoked emotions is critical for multimodal large language models (MLLMs) to achieve comprehensive affect-aware interactions. However, existing benchmarks typically examine expressed and evoked emotions in isolation or are constrained to coarse-grained and incomplete affective characterizations. To bridge this gap, we introduce E$^3$mo-Bench, a scalable benchmark comprising $12{,}314$ question-answer pairs across $2{,}524$ videos with predefined affective perspectives. It evaluates evoked and expressed emotion understanding via $3$ complementary tasks: emotion perception, open-vocabulary recognition, and valence-arousal-dominance (VAD) assessment. To efficiently scale reliable continuous annotations, we propose Bayesian Pairwise Alignment, which aggregates sparse, low-burden pairwise judgments into anchor-referenced VAD estimates. Furthermore, we develop E$^3$mo-Score, a training-free agent that aggregates complementary judgments from a five-model committee to improve VAD estimation. Extensive experiments validate the effectiveness of our framework and expose a pronounced performance skew between evoked and expressed emotion paradigms. These findings, coupled with MLLMs' persistent deficits in fine-grained recognition and dimensional assessment, chart a clear course for advancing multimodal emotional intelligence.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-12 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2608.10796 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T06:25:27.285Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).