Metraipolis › archive › dc_afffe9e8b8a7

Reading Between the Frames of Multimodal Drivelology — arXiv:2608.04939

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.04939
License (as archived)
CC0-1.0
Archived
2026-10-31T11:25:19.058Z
SHA-256 of the archived text
001302ffc02728e073fb7e0272db9854776e92055431c17cd365e23691d3378e
Stable URL of this page
https://metraipolis.com/documento/dc_afffe9e8b8a7

How to cite

Reading Between the Frames of Multimodal Drivelology — arXiv:2608.04939 — arXiv (en), https://arxiv.org/abs/2608.04939 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_afffe9e8b8a7 (Metraipolis archive dc_afffe9e8b8a7, sha256 001302ffc02728e073fb7e0272db9854776e92055431c17cd365e23691d3378e)
BibTeX
@misc{dcafffe9e8b8a7,
  title = {Reading Between the Frames of Multimodal Drivelology — arXiv:2608.04939},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.04939},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_afffe9e8b8a7; sha256 001302ffc02728e073fb7e0272db9854776e92055431c17cd365e23691d3378e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.04939. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Social media videos often communicate meanings that go beyond their visible actions, captions, or speech. A mundane clip may become humorous, ironic, or satire only through the interaction of multimodal cues and cultural context, making such content a difficult test case for video-language models. In this paper, we introduce DrivelHub+, a benchmark for evaluating whether models can infer the implicit, non-linear, and rhetorically layered meanings of social media videos that appear nonsensical on the surface but convey deliberate pragmatic meanings. DrivelHub+ consists of 1,000 videos collected from social media, each annotated with a human-written implicit narrative explanation. Unlike conventional video understanding tasks focused on recognition or description, we present a benchmark that targets contextual multimodal reasoning. We evaluate current video-language models from two perspectives: explanation, where models must explain the pragmatic comprehension of a video in natural language; and representation, where we adapt reasoning-as-retrieval to test whether model representations align videos with their corresponding implicit narratives in both video-to-text and text-to-video retrieval. Our benchmark provides a diagnostic setting for measuring the gap between multimodal perception and pragmatic comprehension, asking whether current models can move beyond describing what is shown to inferring what is meant.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-06 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2608.04939 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-31T11:13:23.194Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-06?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).