Metraipolis › archive › dc_bc53ca0fb087

MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education — arXiv:2609.19088

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.19088
License (as archived)
CC0-1.0
Archived
2026-10-15T13:50:04.304Z
SHA-256 of the archived text
cbda4a64241358d3bae146ff3d35b44d355908cb811c6d5a8edea4eb72b29f6e
Stable URL of this page
https://metraipolis.com/documento/dc_bc53ca0fb087

How to cite

MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education — arXiv:2609.19088 — arXiv (en), https://arxiv.org/abs/2609.19088 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_bc53ca0fb087 (Metraipolis archive dc_bc53ca0fb087, sha256 cbda4a64241358d3bae146ff3d35b44d355908cb811c6d5a8edea4eb72b29f6e)
BibTeX
@misc{dcbc53ca0fb087,
  title = {MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Education — arXiv:2609.19088},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.19088},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_bc53ca0fb087; sha256 cbda4a64241358d3bae146ff3d35b44d355908cb811c6d5a8edea4eb72b29f6e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.19088. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large vision-language models have achieved remarkable progress in multi-modal understanding, yet their capabilities in educational settings remain insufficiently evaluated. In AI-assisted language learning, models must interpret artistic imagery, understand its semantic, affective, and cultural content, and reason about visual context to support meaningful interaction. However, existing benchmarks primarily focus on real-world images or domain-specific educational reasoning, providing limited coverage of artistic educational content. To address this gap, we introduce MUSE, a benchmark for evaluating large vision-language models on artistic image understanding in situated educational applications. MUSE decouples image annotation from question generation, enabling diverse tasks with controllable difficulty while reducing annotation effort. It comprises twelve tasks spanning visual perception, semantic and affective interpretation, culture understanding, and compositional reasoning, together with diverse artistic images deliberately curated to center Singaporean and Southeast Asian multicultural contexts alongside Western art traditions, covering multiple themes and difficulty levels. Evaluation of open-source and proprietary models reveals substantial disparities across capability dimensions, particularly in affective interpretation and compositional reasoning. Our analysis further identifies common failure modes and key challenges for developing trustworthy multi-modal models for education. We hope MUSE will serve as a standardized benchmark for advancing multi-modal understanding in situated educational applications.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-17 in cs.CL).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.19088 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T13:48:24.448Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).