Metraipolis › archive › dc_eec1bd054027

Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition — arXiv:2609.29556

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.29556
License (as archived)
CC0-1.0
Archived
2026-10-08T04:26:15.135Z
SHA-256 of the archived text
452e282600bd00d5993096025e017b834f4b5b84ff5d228f6ace7f69f20396af
Stable URL of this page
https://metraipolis.com/documento/dc_eec1bd054027

How to cite

Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition — arXiv:2609.29556 — arXiv (en), https://arxiv.org/abs/2609.29556 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_eec1bd054027 (Metraipolis archive dc_eec1bd054027, sha256 452e282600bd00d5993096025e017b834f4b5b84ff5d228f6ace7f69f20396af)
BibTeX
@misc{dceec1bd054027,
  title = {Cross-Modal Emotion Understanding: A Transformer-GAT Approach for Dialogue Emotion Recognition — arXiv:2609.29556},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.29556},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_eec1bd054027; sha256 452e282600bd00d5993096025e017b834f4b5b84ff5d228f6ace7f69f20396af},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29556. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Multimodal emotion recognition is a key research area in affective computing, with applications in sentiment analysis, intelligent customer service, and human-computer interaction. However, existing methods often rely on single-modal features or simple multimodal fusion, failing to capture the synergy between global and local contexts, which limits model performance and emotion understanding. To address this challenge, we propose Transformer-GAT, a hybrid framework that combines Transformer and the Graph Attention Network to enable cross-modal emotion understanding. The Transformer is used to capture global semantic information, while the Graph Attention Network is employed to model fine-grained relationships between modalities, thereby enhancing the representation of emotional features. Experiments on the IEMOCAP and MELD datasets show that our model achieves weighted F1 scores of 72.45% and 77.37%, outperforming state-of-the-art methods. These results demonstrate that Transformer-GAT effectively integrates multimodal features, balances global and local contexts, and provides deeper emotional insights, offering new directions for multimodal emotion computing.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-25 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.29556 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T03:50:57.797Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).