Metraipolis › archive › dc_0db7a1a535ef

Exploring Diffusion Transformers for Cross-Modal Augmentation in Multimodal Brain State Decoding — arXiv:2609.11341

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.11341
License (as archived)
CC0-1.0
Archived
2026-10-16T05:24:09.706Z
SHA-256 of the archived text
c8b66beb5ffb13ec9abd55ac1184b58cb705e482cbc9cf2ab29b6f5efaede310
Stable URL of this page
https://metraipolis.com/documento/dc_0db7a1a535ef

How to cite

Exploring Diffusion Transformers for Cross-Modal Augmentation in Multimodal Brain State Decoding — arXiv:2609.11341 — arXiv (en), https://arxiv.org/abs/2609.11341 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_0db7a1a535ef (Metraipolis archive dc_0db7a1a535ef, sha256 c8b66beb5ffb13ec9abd55ac1184b58cb705e482cbc9cf2ab29b6f5efaede310)
BibTeX
@misc{dc0db7a1a535ef,
  title = {Exploring Diffusion Transformers for Cross-Modal Augmentation in Multimodal Brain State Decoding — arXiv:2609.11341},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.11341},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_0db7a1a535ef; sha256 c8b66beb5ffb13ec9abd55ac1184b58cb705e482cbc9cf2ab29b6f5efaede310},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.11341. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Multimodal brain state decoding has largely focused on fusing paired modalities for prediction, but has rarely explored how their correspondence can be further exploited to enrich training data and improve multimodal representation learning. To address this gap, we propose CoMA-DiT, a bidirectional cross-modal Diffusion Transformer for latent augmentation that treats paired modalities as sources of mutual generative supervision rather than merely as inputs to be fused. CoMA-DiT conditions velocity prediction on the paired modality through cross-modal attention and adaptively injects the resulting variation via a reliability-gated residual mechanism. Experiments on multimodal auditory attention decoding and emotion recognition showed that CoMA-DiT consistently outperformed 20 representative baselines, achieving absolute gains of 4.28% and 6.70% in accuracy and macro-F1 over the no-augmentation baseline, respectively. Extensive ablation, sensitivity, visualization, and interpretability analyses further demonstrated its robustness, generalizability, and ability to capture functionally relevant cross-modal interactions. These findings support a broader view of multimodal learning: Paired modalities can serve not only as inputs for fusion but also as supervision sources that augment one another.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-11 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.11341 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T05:17:52.010Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).