Metraipolis › archive › dc_ff7a4c7cb5a2
From Belief Inference to Task Action: A Multi-Level Evaluation of Theory of Mind on Verifiable Tasks — arXiv:2610.34759
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.34759
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-27T08:11:38.555Z
- SHA-256 of the archived text
eeb2c3ccaf5647f2fa618231a0551e10153b5fcf045e7af2759a4abefee89b84- Stable URL of this page
https://metraipolis.com/documento/dc_ff7a4c7cb5a2
How to cite
From Belief Inference to Task Action: A Multi-Level Evaluation of Theory of Mind on Verifiable Tasks — arXiv:2610.34759 — arXiv (en), https://arxiv.org/abs/2610.34759 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ff7a4c7cb5a2 (Metraipolis archive dc_ff7a4c7cb5a2, sha256 eeb2c3ccaf5647f2fa618231a0551e10153b5fcf045e7af2759a4abefee89b84)
BibTeX
@misc{dcff7a4c7cb5a2,
title = {From Belief Inference to Task Action: A Multi-Level Evaluation of Theory of Mind on Verifiable Tasks — arXiv:2610.34759},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.34759},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ff7a4c7cb5a2; sha256 eeb2c3ccaf5647f2fa618231a0551e10153b5fcf045e7af2759a4abefee89b84},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.34759. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Effective collaboration requires language models to understand what others know and believe, and to act accordingly. Models that assume others share their information may omit necessary communication and undermine coordination. Many theory-of-mind (ToM) benchmarks assess mental-state inference through story questions, but correct answers do not establish that models can use these judgments in subsequent tasks. We introduce a multi-level evaluation built on existing, verifiable tasks. We extend household collaboration and calendar scheduling with asymmetric information while retaining their original constraints and validators. Independent interfaces assess world understanding, information access, beliefs, decisions, and execution. Controls supply personal evidence or correct beliefs to distinguish state recovery from state use. Across six model configurations, these abilities diverge. On matched scheduling cases, Claude recovers all agent beliefs correctly but produces subjectively optimal plans in only 67.9% of cases. In household collaboration, supplying beliefs raises Qwen-27B success from 55.0% to 75.0%, yet Qwen-4B answers every fixed supplied-belief source question correctly while completing only 20.0% of the corresponding continuation condition. These results show why ToM evaluation must connect perspective inference to independently verified decisions and task consequences. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2610.34759 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-27T07:56:00.236Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).