Metraipolis › archive › dc_e2ec50dba7f4
The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation — arXiv:2609.02367
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.02367
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T05:50:23.566Z
- SHA-256 of the archived text
21526409864526a65eec06ec429853d7c8069fa57a8047054ad403040ec304f6- Stable URL of this page
https://metraipolis.com/documento/dc_e2ec50dba7f4
How to cite
The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation — arXiv:2609.02367 — arXiv (en), https://arxiv.org/abs/2609.02367 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e2ec50dba7f4 (Metraipolis archive dc_e2ec50dba7f4, sha256 21526409864526a65eec06ec429853d7c8069fa57a8047054ad403040ec304f6)
BibTeX
@misc{dce2ec50dba7f4,
title = {The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation — arXiv:2609.02367},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.02367},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e2ec50dba7f4; sha256 21526409864526a65eec06ec429853d7c8069fa57a8047054ad403040ec304f6},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.02367. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Joint audio-video generation models have made substantial progress in visual quality and audio-visual synchronization. However, they still provide limited control over when shot transitions occur and dialogue is spoken. This limitation constrains their application in script-driven content creation, where timing errors can undermine narrative coherence and the viewing experience. Current joint generators align video and audio representations on a shared temporal axis, yet the precise timing of shots and dialogue specified in a structured prompt is encoded only in the prompt's text representation and remains unaligned with the temporal coordinates of either modality. Consequently, video and audio may remain synchronized with each other while both fail to follow the script timeline. This mismatch motivates us to extend temporal alignment beyond video and audio to include the structured script. We therefore introduce Temporal Context Routing (TCR), which maps the script timing onto the shared temporal axis of video and audio generation and routes each prompt's guidance to the corresponding positions in both modalities. Compared with the baseline on 200 test scripts, TCR reduces Shot Boundary MAE by 96%, from 1.11 s to 0.042 s, and raises Dialogue [email protected] s from 28.3% to 84.1%. TCR achieves these improvements while maintaining visual quality and audio-visual synchronization comparable to those of the baselines. A user study further shows that participants prefer TCR on all five evaluated dimensions. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-03 in cs.CV). Categorie arXiv: Multimedia (cs.MM) ; Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2609.02367 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T05:25:58.189Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-03?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).