Metraipolis › archive › dc_fa1b05a68544

PhysCount: Do MLLMs Count Visual Appearances or Physical Entities? — arXiv:2610.40530

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.40530
License (as archived)
CC0-1.0
Archived
2026-11-01T02:42:28.684Z
SHA-256 of the archived text
bbd2a3428ea066427c58e89303167d06607aed6db874701c7dfdc7413fe1de81
Stable URL of this page
https://metraipolis.com/documento/dc_fa1b05a68544

How to cite

PhysCount: Do MLLMs Count Visual Appearances or Physical Entities? — arXiv:2610.40530 — arXiv (en), https://arxiv.org/abs/2610.40530 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fa1b05a68544 (Metraipolis archive dc_fa1b05a68544, sha256 bbd2a3428ea066427c58e89303167d06607aed6db874701c7dfdc7413fe1de81)
BibTeX
@misc{dcfa1b05a68544,
  title = {PhysCount: Do MLLMs Count Visual Appearances or Physical Entities? — arXiv:2610.40530},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.40530},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fa1b05a68544; sha256 bbd2a3428ea066427c58e89303167d06607aed6db874701c7dfdc7413fe1de81},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.40530. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Images reveal appearances, but counting often asks about physical objects. A single entity may be visible directly, in several reflections, or through glass, so detecting every visible occurrence does not determine how many entities are present. Existing visual counting benchmarks rarely separate these two operations. We introduce PhysCount, a benchmark for evaluating whether multimodal large language models (MLLMs) can distinguish what appears in an image from what physically exists in the scene. PhysCount contains 546 real-world images and 4,595 human-written questions organized into 651 target-specific groups. For each group, annotators locate the relevant appearances, label how each is observed, and identify appearances of the same entity. Four complementary question families test the enumeration of appearances, the enumeration of physical entities, image-formation-specific counting, and appearance--entity correspondence. We measure both accuracy on each family and the proportion of groups answered entirely correctly. Across 40 MLLMs, counting visible appearances is substantially easier than recovering the identities that connect them. Even the strongest model answers every question correctly in only 13.36\% of groups. Performance declines when one entity produces many appearances or when its appearances cross observation modes. Higher image resolution improves access to visual evidence but brings limited gains in complete-group accuracy, whereas answering related questions jointly produces a marked improvement. These results expose a gap between recognizing what is visible and correctly recovering the physical entities behind those observations.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2610.40530 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-01T02:16:43.992Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).