Metraipolis › archive › dc_ee23941ea27a
PRISM-Bench: An Audio-Centric Diagnostic Benchmark for Text-to-Audio-Video Generation — arXiv:2609.04867
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.04867
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T22:26:43.963Z
- SHA-256 of the archived text
617a02ad7a0bb31a4172deaa29fbaff73cbec542755b041e98996f985f36853a- Stable URL of this page
https://metraipolis.com/documento/dc_ee23941ea27a
How to cite
PRISM-Bench: An Audio-Centric Diagnostic Benchmark for Text-to-Audio-Video Generation — arXiv:2609.04867 — arXiv (en), https://arxiv.org/abs/2609.04867 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ee23941ea27a (Metraipolis archive dc_ee23941ea27a, sha256 617a02ad7a0bb31a4172deaa29fbaff73cbec542755b041e98996f985f36853a)
BibTeX
@misc{dcee23941ea27a,
title = {PRISM-Bench: An Audio-Centric Diagnostic Benchmark for Text-to-Audio-Video Generation — arXiv:2609.04867},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.04867},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ee23941ea27a; sha256 617a02ad7a0bb31a4172deaa29fbaff73cbec542755b041e98996f985f36853a},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.04867. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Text-to-audio-video (T2AV) generation has advanced rapidly, but its evaluation still underestimates the audio modality. Existing benchmarks either treat audio as an auxiliary component of video quality or assess it in isolation from audiovisual grounding, making it difficult to diagnose where current systems truly succeed or fail in audio generation. We present PRISM-Bench, the first audio-centric diagnostic benchmark for T2AV generation. Built from a rigorously curated dataset of 900 human-verified samples, PRISM-Bench factorizes audio evaluation along two orthogonal axes: audio type (Speech, Music, and Sound) and sound-source visibility (On-screen vs. Off-screen). It evaluates generated content across four perceptual dimensions (Audio-Visual Coherence, Audio Quality, Audio Expressiveness, and Prompt Following) with 35 fine-grained criteria. To ensure reliable assessment, we adopt an enhanced MLLM-as-a-Judge protocol based on blind, side-by-side comparison against ground-truth references, demonstrating strong alignment (over 70% mean agreement) with human raters. Our evaluation of recent T2AV systems highlights a significant performance gap between frontier and open-source models. Furthermore, we demonstrate that current generation paradigms overfit to perceptual fidelity while struggling with complex grounding and control tasks, particularly in generating music and synchronized On-screen audio. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-07 in cs.AI). Categorie arXiv: Multimedia (cs.MM) ; Artificial Intelligence (cs.AI); Sound (cs.SD). Pagina del lavoro: https://arxiv.org/abs/2609.04867 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T22:18:11.540Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).