Metraipolis › archive › dc_428854cc9178

Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations — arXiv:2610.03017

Source
arXiv
Original
https://arxiv.org/abs/2610.03017
License (as archived)
CC0-1.0
Archived
2026-10-05T22:49:26.833Z
SHA-256 of the archived text
70bc6a03c01f0bfaeeeeae36514f69ae5ba8bb42471f7a44b3ed2655d1323147
Stable URL of this page
https://metraipolis.com/documento/dc_428854cc9178

How to cite

Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations — arXiv:2610.03017 — arXiv, https://arxiv.org/abs/2610.03017 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_428854cc9178 (Metraipolis archive dc_428854cc9178, sha256 70bc6a03c01f0bfaeeeeae36514f69ae5ba8bb42471f7a44b3ed2655d1323147)
BibTeX
@misc{dc428854cc9178,
  title = {Personalized Automatic Speech Recognition for a Dysarthric and Tracheostomic Speaker using Artificial Conversations — arXiv:2610.03017},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.03017},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_428854cc9178; sha256 70bc6a03c01f0bfaeeeeae36514f69ae5ba8bb42471f7a44b3ed2655d1323147},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.03017. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

This work presents an automatic speech recognition (ASR) system personalized for a Czech speaker with a permanent tracheal stoma and severe dysarthria rendering their speech unintelligible to untrained listeners. We release a public dataset containing 33 annotated hours of the speaker's speech, collected using a novel "artificial conversation" protocol designed for high engagement and dialogue realism. We propose a multi-stage training pipeline based on Whisper Base: fine-tuning on standard Czech speech, acoustically simulated tracheostomic speech, and the speaker's data. We evaluate the system across three near real-time scenarios: scripted conversations, question answering, and spontaneous dialogue, achieving a 50\% relative reduction in Character Error Rate compared to Whisper Base baseline and surpassing the average recognition accuracy of their assistants in acoustic recognition of isolated utterances. We demonstrate that even for severely impeded speech, a helpful ASR is achievable, as evidenced by the quantitative results and the feedback from the speaker.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD).
Pagina del lavoro: https://arxiv.org/abs/2610.03017 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-05T22:45:55.665Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).