Metraipolis › archive › dc_41ff52df444b
Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation — arXiv:2608.10932
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.10932
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:09:33.186Z
- SHA-256 of the archived text
800ede1a618647008a48ba253454602c8821c97b64741a485de14988d7dce918- Stable URL of this page
https://metraipolis.com/documento/dc_41ff52df444b
How to cite
Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation — arXiv:2608.10932 — arXiv (en), https://arxiv.org/abs/2608.10932 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_41ff52df444b (Metraipolis archive dc_41ff52df444b, sha256 800ede1a618647008a48ba253454602c8821c97b64741a485de14988d7dce918)
BibTeX
@misc{dc41ff52df444b,
title = {Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation — arXiv:2608.10932},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.10932},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_41ff52df444b; sha256 800ede1a618647008a48ba253454602c8821c97b64741a485de14988d7dce918},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10932. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding camera motion is fundamental to video perception, with applications in spatial intelligence and controllable video generation. Multimodal large language models (MLLMs) provide a natural interface for this task, but existing work typically assigns one or more labels to an entire clip. Such clip-level recognition overlooks two defining properties of real camera motion: it can change within a shot, and multiple movements can occur simultaneously. We therefore formulate camera-motion understanding as temporally grounded, compositional recognition, which requires a model to localize motion-consistent intervals and identify every movement active within each interval. We introduce CamChoreo, a benchmark of 4,229 real single-shot clips with expert-annotated temporal segments. Its annotations use a compact vocabulary of 20 direction-aware labels, and nearly half of the segments contain compound camera motion, with multiple movement primitives active simultaneously. Recognizing such fine-grained, compositional motion is hard for current MLLMs, whose visual encoders emphasize semantic content rather than the geometric evidence on which camera motion depends. Directly injecting features from a frozen 3D foundation model addresses this gap, but requires running the expensive geometry model on every input; we refer to this baseline as CamInject. We instead propose CamDistill, which distills the same geometric knowledge into lightweight camera tokens during training and removes the 3D model at inference. CamDistill matches the accuracy of direct feature injection without running the 3D teacher at inference. Together, CamChoreo and CamDistill advance camera-motion understanding from clip-level labeling to temporally grounded, compositional recognition. Project page: this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-12 in cs.AI). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.10932 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T05:57:28.415Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).