Metraipolis › archive › dc_6431593dc4fe

TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking — arXiv:2609.18585

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.18585
License (as archived)
CC0-1.0
Archived
2026-10-15T15:08:05.292Z
SHA-256 of the archived text
ef1c1f6776408e636fb9390cbefea32efbcf4ad90d10285a963af528dbd501f6
Stable URL of this page
https://metraipolis.com/documento/dc_6431593dc4fe

How to cite

TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking — arXiv:2609.18585 — arXiv (en), https://arxiv.org/abs/2609.18585 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6431593dc4fe (Metraipolis archive dc_6431593dc4fe, sha256 ef1c1f6776408e636fb9390cbefea32efbcf4ad90d10285a963af528dbd501f6)
BibTeX
@misc{dc6431593dc4fe,
  title = {TTM-Bench: A Framework for Text-to-Music System Performance Benchmarking — arXiv:2609.18585},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.18585},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6431593dc4fe; sha256 ef1c1f6776408e636fb9390cbefea32efbcf4ad90d10285a963af528dbd501f6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.18585. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Text-to-music (TTM) systems are increasingly used to generate musical audio from natural-language descriptions. Robust evaluation is therefore essential, yet reliable performance comparison remains challenging. This difficulty stems from differences in system architecture, supported conditioning information, and access mode, as well as heterogeneous and fragmented metrics that cannot be applied uniformly across systems. To address these challenges, we introduce TTM-Bench, a framework that defines a common protocol for systematic, reproducible performance benchmarking of contemporary TTM systems. It evaluates performance along two dimensions: musical-content alignment, quantified by interpretable semantic, genre, and musical-descriptor agreement scores against a common musical specification and summarized by an aggregate score; and computational efficiency, characterized by generation latency and real-time factor, alongside resource use for local models and cost for hosted services. We demonstrate the framework through a preliminary comparative case study, illustrating the complementary evidence captured by these dimensions. The results show that higher musical-content alignment does not systematically coincide with lower computational demands, highlighting the importance of assessing TTM performance through distinct, interpretable measures rather than a reductive overall indicator.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-17 in cs.LG).
Categorie arXiv: Sound (cs.SD) ; Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS).
Pagina del lavoro: https://arxiv.org/abs/2609.18585 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T14:08:19.263Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).