Metraipolis › archive › dc_32ec6dccbce7

VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents — arXiv:2610.04706

Source
arXiv
Original
https://arxiv.org/abs/2610.04706
License (as archived)
CC0-1.0
Archived
2026-10-06T05:26:23.501Z
SHA-256 of the archived text
3cdce9b3e310155f5d09984d4b132cbcb0d2c38e4c686470e1cfe82753b6870c
Stable URL of this page
https://metraipolis.com/documento/dc_32ec6dccbce7

How to cite

VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents — arXiv:2610.04706 — arXiv, https://arxiv.org/abs/2610.04706 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_32ec6dccbce7 (Metraipolis archive dc_32ec6dccbce7, sha256 3cdce9b3e310155f5d09984d4b132cbcb0d2c38e4c686470e1cfe82753b6870c)
BibTeX
@misc{dc32ec6dccbce7,
  title = {VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents — arXiv:2610.04706},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.04706},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_32ec6dccbce7; sha256 3cdce9b3e310155f5d09984d4b132cbcb0d2c38e4c686470e1cfe82753b6870c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.04706. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

People write and sketch while speaking to explain, organize, and develop content together. Inspired by these practices, we investigate how voice agents can use a canvas alongside speech in multi-turn conversations with users. We conducted a two-part formative study: an observational study of how pairs coordinated speech and boardwork, followed by a design workshop that informed a design space for speech-canvas interaction with voice agents. Building on these insights, we developed VoCa, a voice agent that coordinates speech with visual object creation, annotation, and attention guidance. A five-day deployment with 18 participants examined usability, experiences of speech-canvas interaction, patterns of use, and desired improvements. Participants' experiences highlighted opportunities for speech-canvas interaction in learning, work, and daily life, alongside challenges in coordinating what agents say and show in ways users can follow and influence. These findings inform how voice agents can use a canvas alongside speech in conversation.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.04706 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T05:24:05.904Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).