Metraipolis › archive › dc_eb95b17be585
VocalEyes: Speaker-Aware Augmented Reality Captioning through In-Conversation Registration — arXiv:2609.32983
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.32983
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T22:35:28.624Z
- SHA-256 of the archived text
fe60c1a2416bdb444c863388615e4bfce09466f84a39d0367a50b2d322af77ee- Stable URL of this page
https://metraipolis.com/documento/dc_eb95b17be585
How to cite
VocalEyes: Speaker-Aware Augmented Reality Captioning through In-Conversation Registration — arXiv:2609.32983 — arXiv (en), https://arxiv.org/abs/2609.32983 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_eb95b17be585 (Metraipolis archive dc_eb95b17be585, sha256 fe60c1a2416bdb444c863388615e4bfce09466f84a39d0367a50b2d322af77ee)
BibTeX
@misc{dceb95b17be585,
title = {VocalEyes: Speaker-Aware Augmented Reality Captioning through In-Conversation Registration — arXiv:2609.32983},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.32983},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_eb95b17be585; sha256 fe60c1a2416bdb444c863388615e4bfce09466f84a39d0367a50b2d322af77ee},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.32983. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Co-located augmented reality (AR) captions make speech readable, but they can separate an utterance from the person who produced it. In unfamiliar groups, losing that source complicates immediate responses and later review: users must recover not only what was said, but also who said it. Conventional diarization returns anonymous clusters, while speaker recognition typically assumes pre-meeting enrollment. We built VocalEyes, a speaker-aware AR captioning system that creates named voice profiles from natural self-introductions. The interface coordinates speaker-attributed captions, a fixed profile card, and a visual cue that marks the articulating face. In a controlled within-subjects study with 20 participants who reported typical hearing, VocalEyes identified speakers with 88.0% accuracy and increased participant speaker-tracking accuracy from 47.2% with caption-only AR to 87.3% with the complete interface. Participants also reported lower workload with the complete interface. These findings show how in-conversation registration can preserve speaker attribution across live captions and meeting records in scripted small-group meetings. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.HC). Categorie arXiv: Human-Computer Interaction (cs.HC). Pagina del lavoro: https://arxiv.org/abs/2609.32983 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T22:13:52.217Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).