Metraipolis › archive › dc_cf33156e490f

Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections — arXiv:2608.11576

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.11576
License (as archived)
CC0-1.0
Archived
2026-10-19T05:49:48.737Z
SHA-256 of the archived text
ddb1af86a4e167ff3fc0ab970ee7b3f72b18bbe998c99c4c0afe7fbb79224703
Stable URL of this page
https://metraipolis.com/documento/dc_cf33156e490f

How to cite

Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections — arXiv:2608.11576 — arXiv (en), https://arxiv.org/abs/2608.11576 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cf33156e490f (Metraipolis archive dc_cf33156e490f, sha256 ddb1af86a4e167ff3fc0ab970ee7b3f72b18bbe998c99c4c0afe7fbb79224703)
BibTeX
@misc{dccf33156e490f,
  title = {Dialogue-Aware Video-to-Music Generation Using Public Domain Film Collections — arXiv:2608.11576},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.11576},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cf33156e490f; sha256 ddb1af86a4e167ff3fc0ab970ee7b3f72b18bbe998c99c4c0afe7fbb79224703},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.11576. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Video-to-music generation has drawn growing interest for its role in conveying the emotion of visual media, including film. Progress in the field, however, is hampered by a reproducibility gap: models are often trained on crawled corpora referenced through YouTube URLs that may be deleted, with the underlying data often difficult and time-consuming to retrieve. To address this, we introduce the Open Screen Soundtrack Library version 2 (OSSL-v2), a self-hosted corpus of 34,343 video clips totaling 246.4 hours, sourced from public-domain films. Unlike crawled corpora, OSSL-v2 is reproducible (i.e., not subject to link rot) and copyright-conscious, yet still large enough to train functional video-to-music models. We then use this film-domain corpus to study dialogue as a conditioning signal for video-to-music generation, motivated by the close temporal coupling between film music and on-screen speech. Specifically, we augment existing models' video cross-attention with a time axis and modulate it frame-by-frame with the dialogue track. Evaluated on both public-domain and commercial films, our approach shows improvement over the state-of-the-art baselines. The dataset is available at this https URL .

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-13 in cs.CV).
Categorie arXiv: Sound (cs.SD) ; Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM).
Pagina del lavoro: https://arxiv.org/abs/2608.11576 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T05:42:25.939Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-08-13?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).