Metraipolis › archive › dc_edb7ca849970

Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V — arXiv:2610.28416

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.28416
License (as archived)
CC0-1.0
Archived
2026-10-21T07:08:30.033Z
SHA-256 of the archived text
0097f9facc0c0c53a0aa5e0591cb4a2f73b2dc0d7eed25ec481b7a6ce6a64ec3
Stable URL of this page
https://metraipolis.com/documento/dc_edb7ca849970

How to cite

Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V — arXiv:2610.28416 — arXiv (en), https://arxiv.org/abs/2610.28416 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_edb7ca849970 (Metraipolis archive dc_edb7ca849970, sha256 0097f9facc0c0c53a0aa5e0591cb4a2f73b2dc0d7eed25ec481b7a6ce6a64ec3)
BibTeX
@misc{dcedb7ca849970,
  title = {Code2Video-Compass: A Comprehensive Benchmark for General-Purpose Code-Based Video Generation across T2V, I2V, and V2V — arXiv:2610.28416},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.28416},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_edb7ca849970; sha256 0097f9facc0c0c53a0aa5e0591cb4a2f73b2dc0d7eed25ec481b7a6ce6a64ec3},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.28416. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Code-based video generation offers fine-grained control, targeted editing, and component reuse compared with direct video generation. This approach requires multimodal large language models (MLLMs) to translate visual and temporal requirements into executable programs that produce complete videos. However, existing code-based benchmarks primarily target specialized tasks, leaving complete video creation across diverse creative categories and input modalities insufficiently evaluated. We introduce Code2Video-Compass, a general-purpose benchmark for code-based video generation across text-to-video (T2V), image-to-video (I2V), and video-to-video (V2V) settings. Code2Video-Compass comprises 2,104 tasks spanning 10 categories, 24 subtypes, and three complexity dimensions covering construction, dynamic animation, and state dependency. It combines tasks curated from textual instructions and visual references with corresponding T2V, I2V, and V2V tasks derived from complete professional and user-created videos. We propose a dual-level evaluation framework combining 12 objective metrics and five subjective metrics. Objective evaluation covers operational performance, video quality, text-video alignment, and reference fidelity, while subjective evaluation uses an MLLM judge to evaluate instruction following and holistic video quality. Extensive evaluation of 15 recent proprietary and open-weight MLLMs from nine families reveals that even leading models face challenges in reliably generating high-quality complete videos aligned with textual and visual requirements, with performance generally declining as construction, dynamic animation, and state-dependency complexity increases. We anticipate that Code2Video-Compass will advance reliable, coherent, and controllable code-based video generation and inspire broader progress in programmatic visual creation.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.28416 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-21T07:05:43.652Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).