Metraipolis › archive › dc_37eecbde2032

Audible World Models: Spatially Aware Sound Generation for 3D Worlds — arXiv:2609.38444

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.38444
License (as archived)
CC0-1.0
Archived
2026-10-07T14:45:17.722Z
SHA-256 of the archived text
618e9985f6d2e80e3a64813a07a89dbf5e620c923d1847718247a1581dc48cd6
Stable URL of this page
https://metraipolis.com/documento/dc_37eecbde2032

How to cite

Audible World Models: Spatially Aware Sound Generation for 3D Worlds — arXiv:2609.38444 — arXiv (en), https://arxiv.org/abs/2609.38444 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_37eecbde2032 (Metraipolis archive dc_37eecbde2032, sha256 618e9985f6d2e80e3a64813a07a89dbf5e620c923d1847718247a1581dc48cd6)
BibTeX
@misc{dc37eecbde2032,
  title = {Audible World Models: Spatially Aware Sound Generation for 3D Worlds — arXiv:2609.38444},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.38444},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_37eecbde2032; sha256 618e9985f6d2e80e3a64813a07a89dbf5e620c923d1847718247a1581dc48cd6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.38444. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Text- and image-conditioned world generators can create visually rich 3D environments, yet these worlds often remain silent or rely on soundtracks synthesized solely from text or rendered video. Although such audio can convey what should be heard, it lacks an explicit representation of where sound sources are located and how their perceived sound should vary with listener movement. We introduce Audible World Models, a training-free framework that incorporates sound into the generated world state. Starting from a text prompt, our system constructs a panoramic 3D proxy, separates it into semantic layers, identifies sound-producing foreground objects and ambient background regions, and synthesizes dry audio for each sound label. It then anchors these sources to reconstructed geometry and renders listener-dependent spatial audio using geometric acoustic propagation. By explicitly linking semantics, geometry, and sound propagation, the framework maintains persistent source locations while adapting the rendered audio to changes in listener viewpoint and motion. Experiments across 80 generated scenes demonstrate substantial gains in spatial consistency over text-, video-, and panorama-conditioned baselines, while preserving competitive semantic alignment. VLM-based assessments and human evaluations further indicate that our soundtracks are preferred for their audio-visual consistency, spatial plausibility, and motion-dependent behavior.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-10-01 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Sound (cs.SD).
Pagina del lavoro: https://arxiv.org/abs/2609.38444 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T14:19:00.559Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-10-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).