Metraipolis › archive › dc_a694142ca3ed
Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG — arXiv:2608.28699
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.28699
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T09:53:16.909Z
- SHA-256 of the archived text
025db7540dd6c6c8d28f4db6a647340475dac24597400d61f07626b8904b987f- Stable URL of this page
https://metraipolis.com/documento/dc_a694142ca3ed
How to cite
Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG — arXiv:2608.28699 — arXiv (en), https://arxiv.org/abs/2608.28699 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a694142ca3ed (Metraipolis archive dc_a694142ca3ed, sha256 025db7540dd6c6c8d28f4db6a647340475dac24597400d61f07626b8904b987f)
BibTeX
@misc{dca694142ca3ed,
title = {Beyond Visual Boundaries: Rethinking Scene Segmentation for Movie RAG — arXiv:2608.28699},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.28699},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a694142ca3ed; sha256 025db7540dd6c6c8d28f4db6a647340475dac24597400d61f07626b8904b987f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.28699. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding long-form video remains a fundamental challenge for multimodal large language models (MLLMs). Sparse frame sampling fails to capture fine-grained visual details, while dense sampling quickly exceeds context length limits. Retrieval-augmented generation (RAG) offers a promising middle ground by selectively retrieving relevant video segments for grounded generation, yet its effectiveness critically depends on the quality of the video segments used as retrieval units. In this paper, we investigate RAG for movie understanding, which demands story-level reasoning over characters, events, and narrative arcs spanning hours of content. Scene segmentation, a long-studied problem that partitions movies into semantically coherent units, is a natural candidate for defining such retrieval units. We reexamine whether existing methods actually serve this role through comprehensive evaluation on downstream movie understanding tasks, and find that they consistently fail to outperform naive uniform temporal chunking. Our audit of the most standard scene segmentation benchmarks reveals why: current annotations prioritize visually salient transitions over narrative event structure. Motivated by this mismatch, we introduce NarraScene, a narrative-centric scene segmentation dataset annotated with a three-level cognitive taxonomy spanning physical, character, and narrative change, where every valid boundary requires a narrative-level shift. When used as retrieval units, these narrative-grounded segments outperform uniform chunking on downstream movie understanding tasks, suggesting that the central challenge for scene segmentation in movie RAG is not detecting boundaries, but identifying the narrative event units that matter for movie understanding. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-01 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2608.28699 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T09:28:47.942Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).