Metraipolis › archive › dc_287fa9948768

MotionGraphicsBench: Evaluating Motion Graphics Generation with Programmatic Verification — arXiv:2611.10592

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.10592
License (as archived)
CC0-1.0
Archived
2026-11-10T18:42:38.244Z
SHA-256 of the archived text
880c9d2cd77af84a00f82f122a57e5175e04d9c212b20e9b64d92b888b832259
Stable URL of this page
https://metraipolis.com/documento/dc_287fa9948768

How to cite

MotionGraphicsBench: Evaluating Motion Graphics Generation with Programmatic Verification — arXiv:2611.10592 — arXiv (en), https://arxiv.org/abs/2611.10592 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_287fa9948768 (Metraipolis archive dc_287fa9948768, sha256 880c9d2cd77af84a00f82f122a57e5175e04d9c212b20e9b64d92b888b832259)
BibTeX
@misc{dc287fa9948768,
  title = {MotionGraphicsBench: Evaluating Motion Graphics Generation with Programmatic Verification — arXiv:2611.10592},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.10592},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_287fa9948768; sha256 880c9d2cd77af84a00f82f122a57e5175e04d9c212b20e9b64d92b888b832259},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.10592. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models can generate motion graphics from static images and natural language requests, but it remains difficult to evaluate how well models can follow requests that combine spatial, appearance, and temporal requirements. We introduce MotionGraphicsBench, an expert-curated benchmark of 100 instances for animating an input static SVG with a motion edit prompt. By supplying all required visual elements, our editing task reflects a designer-like workflow and isolates motion generation from graphic generation. Derived from real-world Lottie motion designs, our benchmark contains diverse combinations of spatio-temporal animation behaviors. Each benchmark instance pairs its model input with a deterministic, human-readable verification program that accepts different valid implementations and reports which prompt requirements pass or fail, rather than comparing against a reference animation or using a VLM judge. We construct these programs with a multi-agent pipeline using human-labeled animations and synthesized test cases. On a balanced test set of 180 animations, our programs achieve 93.3% raw agreement with human judgments, compared with 83.3% for a GPT-6 Astra VLM baseline, and outperform the baseline in both approval and rejection recall. Across 47 configurations from 32 LLMs and 12 providers, pass@1 ranges from 6.0% to 67.7%. Across 15 models evaluated at their highest available reasoning effort with 32 attempts per instance, additional attempts improve every model, but pass@32 still ranges from 38.0% to 95.0%. Our analysis of verification programs reveals that generated animations often fail to match reference poses, follow requested motion trajectories, or coordinate related events. We release our benchmark at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.10592 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-10T18:37:37.596Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).