Metraipolis › archive › dc_3f709b87e19d

CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech — arXiv:2609.14764

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.14764
License (as archived)
CC0-1.0
Archived
2026-10-16T00:15:38.059Z
SHA-256 of the archived text
f91184165eaa61bc5c388fc459e40067eab6c1500885a47f4339f73b9183a68a
Stable URL of this page
https://metraipolis.com/documento/dc_3f709b87e19d

How to cite

CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech — arXiv:2609.14764 — arXiv (en), https://arxiv.org/abs/2609.14764 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3f709b87e19d (Metraipolis archive dc_3f709b87e19d, sha256 f91184165eaa61bc5c388fc459e40067eab6c1500885a47f4339f73b9183a68a)
BibTeX
@misc{dc3f709b87e19d,
  title = {CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech — arXiv:2609.14764},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.14764},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3f709b87e19d; sha256 f91184165eaa61bc5c388fc459e40067eab6c1500885a47f4339f73b9183a68a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.14764. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Early detection of cognitive decline from speech offers a scalable and non-invasive alternative to conventional clinical assessment. Verbal fluency tasks are particularly informative, but most automated approaches aggregate features across an entire recording, overlooking temporal speech dynamics. We propose the Cognitive Instability-Aware Cross-Modal Attention Network (CCMAN), a transfer learning framework that learns task-agnostic cognitive speech representations from multiple memory-probing tasks before fine-tuning on a minute-long semantic and phonemic verbal fluency task. CCMAN integrates semantic, acoustic, and linguistic information through bidirectional cross-attention, gated multimodal fusion, and transformer-based temporal modelling to derive interpretable biomarkers of cognitive decline. Experiments were conducted on 165.44 hours of speech from 843 participants (498 healthy controls, 245 with mild cognitive impairment, and 100 with dementia). CCMAN achieved Macro-F1 scores of 0.81 and 0.59 for binary and multiclass semantic fluency classification, and 0.77 and 0.53 for phonemic fluency, consistently outperforming strong static and temporal baselines. Statistical analyses showed that semantic drift variance and pause variance, but not mean semantic drift, were significantly elevated in both MCI and dementia relative to healthy controls, while pause duration increased progressively over the task with the steepest slope in dementia, supporting global and progressive temporal speech instability as interpretable biomarkers. Evaluation on the independent PROCESS-2 benchmark further demonstrated the generalisability of the proposed framework, improving the baseline Macro-F1 by up to 9%. These findings support temporal speech instability as a dynamic speech biomarker for robust, interpretable, and generalisable early detection of cognitive decline.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.LG).
Categorie arXiv: Sound (cs.SD) ; Machine Learning (cs.LG); Audio and Speech Processing (eess.AS).
Pagina del lavoro: https://arxiv.org/abs/2609.14764 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T23:54:14.921Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).