Metraipolis › archive › dc_e311cdb85e19

MAESTRO: a Multimodal Auditory-attention Egocentric Speech-TRacking Open corpus — arXiv:2609.31898

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.31898
License (as archived)
CC0-1.0
Archived
2026-10-07T22:35:37.454Z
SHA-256 of the archived text
e2627531d1f0bc95d677661d58b8b0e1d94620c2318b817ab55d6a6146c353ce
Stable URL of this page
https://metraipolis.com/documento/dc_e311cdb85e19

How to cite

MAESTRO: a Multimodal Auditory-attention Egocentric Speech-TRacking Open corpus — arXiv:2609.31898 — arXiv (en), https://arxiv.org/abs/2609.31898 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e311cdb85e19 (Metraipolis archive dc_e311cdb85e19, sha256 e2627531d1f0bc95d677661d58b8b0e1d94620c2318b817ab55d6a6146c353ce)
BibTeX
@misc{dce311cdb85e19,
  title = {MAESTRO: a Multimodal Auditory-attention Egocentric Speech-TRacking Open corpus — arXiv:2609.31898},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.31898},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e311cdb85e19; sha256 e2627531d1f0bc95d677661d58b8b0e1d94620c2318b817ab55d6a6146c353ce},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.31898. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Humans rely on gaze, head movements, and visual cues to attend to speakers in noisy environments, yet auditory attention decoding (AAD) has been studied primarily using electroencephalography (EEG). We introduce the Multimodal Auditory-attention Egocentric Speech-TRacking Open (MAESTRO) corpus, the first AAD dataset to simultaneously record EEG, eye gaze, pupillometry, egocentric video, and head inertial measurement unit (IMU) data. MAESTRO includes four competing speakers and background noise across multiple signal-to-noise ratio (SNR) conditions, enabling attention decoding under realistic listening scenarios. Through a four-speaker attention decoding benchmark, we show that combining behavioral and physiological signals improves decoding performance over EEG-only approaches, enabling future advances in multimodal auditory attention decoding. These findings open the door to new applications, analyses, and methodological advances in multimodal AAD. The complete dataset is publicly available at this https URL . The official code repository is available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.HC).
Categorie arXiv: Audio and Speech Processing (eess.AS) ; Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Neurons and Cognition (q-bio.NC).
Pagina del lavoro: https://arxiv.org/abs/2609.31898 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T22:13:52.264Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).