Metraipolis › archive › dc_334de809f749
VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation — arXiv:2609.12874
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.12874
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T03:57:50.156Z
- SHA-256 of the archived text
619c59de1edd140eb5622cfd6220fc68a635ce26e19ad0011c9a02bf963cd2a3- Stable URL of this page
https://metraipolis.com/documento/dc_334de809f749
How to cite
VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation — arXiv:2609.12874 — arXiv (en), https://arxiv.org/abs/2609.12874 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_334de809f749 (Metraipolis archive dc_334de809f749, sha256 619c59de1edd140eb5622cfd6220fc68a635ce26e19ad0011c9a02bf963cd2a3)
BibTeX
@misc{dc334de809f749,
title = {VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation — arXiv:2609.12874},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.12874},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_334de809f749; sha256 619c59de1edd140eb5622cfd6220fc68a635ce26e19ad0011c9a02bf963cd2a3},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.12874. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Video tokenizers have emerged as a cornerstone of modern video modeling, underpinning progress in compression, reconstruction and generation by mapping high-dimensional visual signals into compact latent spaces. However, despite this progress, current tokenization paradigms largely remain within the 2D visual domain, treating videos as image sequences rather than observations of an underlying dynamic 3D world. Consequently, the learned tokens inherit this observation-centric bias, limiting their capacity to compactly represent real-world 4D scenes. To mitigate this issue, we propose VideoTok4D, a novel 4D-aware video tokenizer for compact world representation. Specifically, our approach comprises three key designs: 1) a spatiotemporal disentanglement strategy that factorizes videos into static and dynamic tokens for holistic world modeling; 2) a track-aware dynamic attention mechanism that aggregates trajectory-aligned cues to promote cross-view motion consistency; and 3) Co4DGen, a diffusion prior learned over the resulting VideoTok4D token space for efficient 4D scene generation. Extensive experiments have demonstrated that our proposed method achieves state-of-the-art performance while requiring up to 4 orders of magnitude less storage than dense 4D representations. Moreover, the compact token space substantially shortens diffusion sequences, enabling efficient generation. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-14 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2609.12874 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T03:44:26.322Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).