Metraipolis › archive › dc_8098eaa99d9c
Talk2Agent: Benchmarking Voice Interfaces for Text Agents — arXiv:2609.38867
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.38867
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T12:42:16.445Z
- SHA-256 of the archived text
a1d2c10448131b8120d19ed48a8b309bdaaea601bc02b9870632379def7f09f1- Stable URL of this page
https://metraipolis.com/documento/dc_8098eaa99d9c
How to cite
Talk2Agent: Benchmarking Voice Interfaces for Text Agents — arXiv:2609.38867 — arXiv (en), https://arxiv.org/abs/2609.38867 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8098eaa99d9c (Metraipolis archive dc_8098eaa99d9c, sha256 a1d2c10448131b8120d19ed48a8b309bdaaea601bc02b9870632379def7f09f1)
BibTeX
@misc{dc8098eaa99d9c,
title = {Talk2Agent: Benchmarking Voice Interfaces for Text Agents — arXiv:2609.38867},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.38867},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8098eaa99d9c; sha256 a1d2c10448131b8120d19ed48a8b309bdaaea601bc02b9870632379def7f09f1},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.38867. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language model (LLM) computer-use agents are typically evaluated with clean written instructions, despite speech being an increasingly popular interface for interacting with such systems. Speech input introduces an additional failure point: transcription errors can alter task-critical entities, constraints, or targets before the agent begins reasoning, while conventional ASR metrics do not directly measure whether the information required for successful execution has been preserved. We introduce Talk2Agent, a benchmark for evaluating how effectively voice interfaces convey human-spoken instructions to LLM-based computer-use agents. Talk2Agent builds human-spoken versions of tasks from WildClawBench and OSWorld and evaluates a range of voice interfaces, including dedicated ASR models, audio-capable LLMs, contextual biasing, and LLM-based ontology repair. Because repeatedly executing long-horizon computer-use tasks is costly and stochastic, we further propose an execution-free, task-conditioned evaluation framework that projects the original task grader onto prompt-addressable intentions and measures how much task-relevant information is retained after the voice interface. On WildClawBench, Talk2Agent's execution-free native projection provides a practical, execution-grounded measure of voice-interface quality, correlating with downstream task completion and improving Pearson correlation by 0.246 over WER/CER on 32 hours of real human speech. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-10-01 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Audio and Speech Processing (eess.AS). Pagina del lavoro: https://arxiv.org/abs/2609.38867 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T12:14:13.700Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-10-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).