Metraipolis › archive › dc_8345ebb8b338
Subject-Invariant Cross-Modal Decoding of Perceived Speech from Brain Recordings — arXiv:2609.30832
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.30832
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T01:39:31.439Z
- SHA-256 of the archived text
7bbcc60ea36514875cbfa22eeb3300f8b581bcaec221b3c5967cdf226fab4b0a- Stable URL of this page
https://metraipolis.com/documento/dc_8345ebb8b338
How to cite
Subject-Invariant Cross-Modal Decoding of Perceived Speech from Brain Recordings — arXiv:2609.30832 — arXiv (en), https://arxiv.org/abs/2609.30832 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8345ebb8b338 (Metraipolis archive dc_8345ebb8b338, sha256 7bbcc60ea36514875cbfa22eeb3300f8b581bcaec221b3c5967cdf226fab4b0a)
BibTeX
@misc{dc8345ebb8b338,
title = {Subject-Invariant Cross-Modal Decoding of Perceived Speech from Brain Recordings — arXiv:2609.30832},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.30832},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8345ebb8b338; sha256 7bbcc60ea36514875cbfa22eeb3300f8b581bcaec221b3c5967cdf226fab4b0a},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.30832. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Perceived speech decoding based on non-invasive brain-computer interface (BCI) signals has been extensively studied in recent years. Research in this field primarily faces two challenges: extracting neural representations with rich spatiotemporal information and achieving cross-subject generalization. Although separate studies have proposed methods to cope with these issues, a unified approach that simultaneously tackles both challenges remains lacking. To fill this gap, we propose the Subject-Invariant Cross-Modal Perceived Speech Decoding (SICMD) method, which integrates functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG). We conduct comprehensive analyses of the fusion method, fusion position, encoder architecture, and model inputs. Our results demonstrate that the proposed method improves Top-1, Top-10, and Rankacc by more than 10.6%, 10.1%, and 1.7%, respectively, compared to baseline methods in cross-subject perceived speech decoding tasks, while reducing training costs by 88.8% and 60.5% compared to multi-subject and intra-subject decoding settings. Further visualization experiments also confirm the effectiveness of our approach. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-28 in cs.AI). Categorie arXiv: Sound (cs.SD) ; Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS). Pagina del lavoro: https://arxiv.org/abs/2609.30832 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T01:12:14.486Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).