Metraipolis › archive › dc_be35c57c32bb

InSituMeasure: Probing Situated Measurement Grounding in Industrial Scenes with Multimodal Large Language Models — arXiv:2609.04014

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.04014
License (as archived)
CC0-1.0
Archived
2026-10-17T01:11:30.099Z
SHA-256 of the archived text
b31b3c3d6d00b684c1c498d77a52dc37f2f09f2cf025d7b1a4fa6b2449fd46e7
Stable URL of this page
https://metraipolis.com/documento/dc_be35c57c32bb

How to cite

InSituMeasure: Probing Situated Measurement Grounding in Industrial Scenes with Multimodal Large Language Models — arXiv:2609.04014 — arXiv (en), https://arxiv.org/abs/2609.04014 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_be35c57c32bb (Metraipolis archive dc_be35c57c32bb, sha256 b31b3c3d6d00b684c1c498d77a52dc37f2f09f2cf025d7b1a4fa6b2449fd46e7)
BibTeX
@misc{dcbe35c57c32bb,
  title = {InSituMeasure: Probing Situated Measurement Grounding in Industrial Scenes with Multimodal Large Language Models — arXiv:2609.04014},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.04014},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_be35c57c32bb; sha256 b31b3c3d6d00b684c1c498d77a52dc37f2f09f2cf025d7b1a4fa6b2449fd46e7},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.04014. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

For trained operators, gauge reading requires little specialized knowledge, low cognitive effort, and high repeatability. Yet Multimodal Large Language Models (MLLMs) remain unreliable in continuous-valued measurement despite strong results on general multimodal benchmarks. Existing benchmarks expose this weakness but isolate measurement from realistic, knowledge-grounded settings, with limited situated context, specialized instruments, real-world noise, and matched diagnostic annotations, reducing realism and constraining root-cause analysis. We introduce InSituMeasure to evaluate situated measurement grounding. It contains 2,922 real industrial monitoring scenes across eight functional categories of professional engineering instruments, with dense gauge-attribute annotations and noise tags for failure diagnosis. We define metrics for numerical accuracy under predefined tolerances and unit consistency, rejection of fake or unanswerable tasks, and alignment between model failures and annotated error factors. Across 24 state-of-the-art MLLMs, the best model reaches only 25.7\% joint value-unit accuracy and 51.8\% confidence-diagnosis F1, revealing a substantial gap between general multimodal competence and reliable situated measurement. Further analysis identifies failures from text-induced shortcuts, overconfident responses, and authentic industrial noise, including mixed disturbances, viewpoint deviation, occlusion, and environmental interference.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-04 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.04014 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T00:28:02.901Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-04?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).