Metraipolis › archive › dc_6008ecfd0386
SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia — arXiv:2609.09672
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.09672
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T07:51:12.309Z
- SHA-256 of the archived text
e1237adcbb17f081a1c882e47466fba115104835a3e68a2899f4181ea0b4542f- Stable URL of this page
https://metraipolis.com/documento/dc_6008ecfd0386
How to cite
SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia — arXiv:2609.09672 — arXiv (en), https://arxiv.org/abs/2609.09672 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6008ecfd0386 (Metraipolis archive dc_6008ecfd0386, sha256 e1237adcbb17f081a1c882e47466fba115104835a3e68a2899f4181ea0b4542f)
BibTeX
@misc{dc6008ecfd0386,
title = {SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia — arXiv:2609.09672},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.09672},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6008ecfd0386; sha256 e1237adcbb17f081a1c882e47466fba115104835a3e68a2899f4181ea0b4542f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.09672. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
The rapid advancement of audio and multimodal large language models has unlocked transformative speech understanding capabilities, yet evaluation frameworks remain predominantly English-centric, leaving Southeast Asian (SEA) languages critically underrepresented. We introduce SEA-SpeechBench, to the best of our knowledge, the first large-scale multitask benchmark that evaluates speech understanding in 11 SEA languages through 97,194 samples across 99 evaluation sets and 597 hours of curated audio data. Our benchmark comprises 9 diverse tasks across 3 categories: speech processing (automatic speech recognition, speech translation, spoken question answering), paralinguistic analysis (emotion, gender, age, speaker recognition), and temporal understanding, a novel dimension featuring timestamped content queries and temporal localization within extended audio sequences up to 3 minutes. We implement multilingual prompting in both native SEA languages and English to reflect user interactions with audio-language models. Evaluation of leading open-source and proprietary systems reveals marked performance gaps. Across all models, performance remains underwhelming on temporal understanding, emotion recognition, and speech translation. Prompting in low-resource languages such as Burmese and Tamil lags behind English by up to 41 percentage points. Our findings expose critical model limitations and underscore the need for inclusive model development. The SEA-SpeechBench benchmark is available at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-10 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.09672 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T07:24:00.884Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).