Metraipolis › archive › dc_95fdd4d8cdc4

RoboQuest: Generalist Physical Agents that Search, Inspect and Test — arXiv:2610.10388

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.10388
License (as archived)
CC0-1.0
Archived
2026-10-08T11:12:03.152Z
SHA-256 of the archived text
12e4e41ced6150269e15c6e4f6d36467e8ad998decaf99047b9a05c00cfc7bcd
Stable URL of this page
https://metraipolis.com/documento/dc_95fdd4d8cdc4

How to cite

RoboQuest: Generalist Physical Agents that Search, Inspect and Test — arXiv:2610.10388 — arXiv (en), https://arxiv.org/abs/2610.10388 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_95fdd4d8cdc4 (Metraipolis archive dc_95fdd4d8cdc4, sha256 12e4e41ced6150269e15c6e4f6d36467e8ad998decaf99047b9a05c00cfc7bcd)
BibTeX
@misc{dc95fdd4d8cdc4,
  title = {RoboQuest: Generalist Physical Agents that Search, Inspect and Test — arXiv:2610.10388},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.10388},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_95fdd4d8cdc4; sha256 12e4e41ced6150269e15c6e4f6d36467e8ad998decaf99047b9a05c00cfc7bcd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.10388. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Recent advances in multimodal foundation models have made them capable generalist physical agents for a range of manipulation tasks. However, successful operation in an unfamiliar environment may require an agent to seek task-relevant information through interaction when it is absent from the observations: it may need to determine where a relevant object is, inspect an unobserved property, or discover the effect of an unfamiliar tool. We thus introduce RoboQuest, a benchmark for goal-directed embodied exploration, where agents must actively acquire task-relevant information through physical interaction, use the resulting evidence to adapt subsequent actions, and autonomously decide when to commit to task completion. RoboQuest comprises ten mobile manipulation tasks centered on three forms of uncertainty: search, manipulation-based inspection, and interactive testing. We evaluate five frontier multimodal agents through a common visuomotor interface, as well as a $\pi_{0.5}$ policy fine-tuned on the full-episode demonstrations we release. The best agent succeeds in only 23\% of the episodes, and the fine-tuned policy almost never succeeds. Isolated tests of the execution skills the tasks are built from, with the hidden information supplied, show that the agents can carry out most of the required actions, and our failure analysis attributes only a minority of the failures to execution. Our failure analysis further finds that the agents often stop exploring too early as they make decisions before observing the required evidence for task completion. We also find that agents rarely prevent or repair the disturbances caused by their exploration. Moreover, learning by trial and error remains difficult for most models.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2610.10388 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T10:14:06.179Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).