Metraipolis › archive › dc_010d2786155f

Task-Centric Multimodal Learning for Cognitive Impairment Detection — arXiv:2610.20906

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.20906
License (as archived)
CC0-1.0
Archived
2026-10-16T10:02:09.233Z
SHA-256 of the archived text
64cfe272355a09f61d0e6ae8d340d82f4be95f778c7bd846a72f38fe67b170ef
Stable URL of this page
https://metraipolis.com/documento/dc_010d2786155f

How to cite

Task-Centric Multimodal Learning for Cognitive Impairment Detection — arXiv:2610.20906 — arXiv (en), https://arxiv.org/abs/2610.20906 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_010d2786155f (Metraipolis archive dc_010d2786155f, sha256 64cfe272355a09f61d0e6ae8d340d82f4be95f778c7bd846a72f38fe67b170ef)
BibTeX
@misc{dc010d2786155f,
  title = {Task-Centric Multimodal Learning for Cognitive Impairment Detection — arXiv:2610.20906},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.20906},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_010d2786155f; sha256 64cfe272355a09f61d0e6ae8d340d82f4be95f778c7bd846a72f38fe67b170ef},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.20906. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Dementia affects millions of older adults worldwide, yet early detection remains difficult outside clinical settings. Traditional models primarily rely on text or voice-based responses, capturing only a limited view of human cognition despite the inherently multimodal nature of human expression. This work proposes a contactless, multimodal screening framework that leverages video, audio, and text signals collected during structured voice-based interactions with Amazon Alexa. By incorporating these modalities, our approach captures a more holistic representation of human behavior encompassing speech patterns, vocal characteristics, facial expressions, and linguistic structure, which may enable more accurate detection of cognitive decline. Different participants completed three conversational tasks designed to probe spontaneous speech, comprehension, and recall. We pursued three objectives: (1) evaluate which of the three Alexa tasks provides the most informative cognitive signals, (2) compare the effectiveness of unimodal models, and (3) assess the benefits of multimodal fusion models. Task-level analysis shows that the video model achieves its best performance on Command-Reading, with an accuracy of 0.65 (AUC 0.69), while the audio model performs best on Question-Answering, reaching an accuracy of 0.67 (AUC 0.73). In contrast, the multimodal model demonstrates consistently stable performance across tasks, achieving an accuracy of 0.76 (AUC 0.75) on Command-Reading and 0.76 (AUC 0.73) on Question-Answering. These findings demonstrate that multimodal behavioral cues captured through naturalistic interactions can reliably distinguish MCI from healthy aging, highlighting the limitations of traditional diagnostic paradigms and supporting the shift toward multimodal, real-world cognitive assessment frameworks.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2610.20906 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T08:44:47.731Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).