Metraipolis › archive › dc_781403ff707b
OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents — arXiv:2609.32569
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.32569
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T23:51:00.100Z
- SHA-256 of the archived text
e93456c90d1ef3559da3dbea3c4d6b80ed4663b0dca35dd72d1ac0f6a149073c- Stable URL of this page
https://metraipolis.com/documento/dc_781403ff707b
How to cite
OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents — arXiv:2609.32569 — arXiv (en), https://arxiv.org/abs/2609.32569 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_781403ff707b (Metraipolis archive dc_781403ff707b, sha256 e93456c90d1ef3559da3dbea3c4d6b80ed4663b0dca35dd72d1ac0f6a149073c)
BibTeX
@misc{dc781403ff707b,
title = {OmniSmartHome: A Multimodal Reasoning Benchmark for Smart-Home Agents — arXiv:2609.32569},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.32569},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_781403ff707b; sha256 e93456c90d1ef3559da3dbea3c4d6b80ed4663b0dca35dd72d1ac0f6a149073c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.32569. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Smart-home assistants are expected to handle diverse, realistic requests that arise in daily life. In such interactions, users often rely on the surrounding multimodal context-pointing at objects or referring to what they see or hear, leaving their requests underspecified in language alone. Existing smart-home benchmarks, however, express user requests solely through language, leaving context-dependent real-world requests underexplored. To bridge this gap, we introduce OmniSmartHome, a multimodal smart-home benchmark where each spoken request is paired with the surrounding visual and spatial-audio context, providing complementary cues to disambiguate underspecified requests. OmniSmartHome comprises 1,360 synthetic and 272 real-world episodes. We evaluate 16 omnimodal large language models (Omni-LLMs) and reveal that, while they perform strongly when speech alone sufficiently conveys the user's intent, performance drops substantially when resolving it requires reasoning over multimodal contextual cues. As a simple agent baseline, we provide PROME (PROcedural Memory for multimodal Evidence gathering), which equips agents with specialized audio-visual perception tools and procedural memory for orchestrating their use. PROME generally improves performance across six Omni-LLMs. Demos and examples are available at this https URL Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-29 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2609.32569 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T23:29:27.071Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).