Metraipolis › archive › dc_63db27e701cf
Show-Harness: Just a VLM Agent Can Play Robots — arXiv:2609.10522
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.10522
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T07:30:37.674Z
- SHA-256 of the archived text
e27c98987f44088f828748f0d0fd0c4bb98c8451f5945bdd35b4515f9ae165d6- Stable URL of this page
https://metraipolis.com/documento/dc_63db27e701cf
How to cite
Show-Harness: Just a VLM Agent Can Play Robots — arXiv:2609.10522 — arXiv (en), https://arxiv.org/abs/2609.10522 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_63db27e701cf (Metraipolis archive dc_63db27e701cf, sha256 e27c98987f44088f828748f0d0fd0c4bb98c8451f5945bdd35b4515f9ae165d6)
BibTeX
@misc{dc63db27e701cf,
title = {Show-Harness: Just a VLM Agent Can Play Robots — arXiv:2609.10522},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.10522},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_63db27e701cf; sha256 e27c98987f44088f828748f0d0fd0c4bb98c8451f5945bdd35b4515f9ae165d6},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.10522. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Foundation vision-language models (VLMs) exhibit broad intelligence about the world, yet translating this intelligence into robot control remains challenging. We present Show-Harness, an Embodied Harness that enables VLMs to "play" robots through a compact semantic interface linking intent to action. Show-Harness exposes discrete semantic action units that VLMs can naturally reason over, while embodiment-specific interpreters deterministically ground them into local robot actions, keeping the VLM directly responsible for fine-grained physical decisions. Through the same interface, Show-Harness demonstrates the feasibility of (1) directly unlocking closed-source frontier VLMs for zero-shot robot control, and (2) adapting small-scale open-source VLMs for low-cost deployment with just a few GPU-hours of fine-tuning. We further develop GUMI (GUI Manipulation Interface), which extends the same semantic action space to GUI-based demonstration collection, allowing humans and agents to "play" robots across embodiments without specialized teleoperation hardware. Extensive experiments show that Show-Harness-equipped VLM agents generalize robustly across tasks, embodiments, and environments, outperforming representative agentic and VLA paradigms. These results suggest that the right interface can unlock substantial embodied capability from foundation VLMs, without requiring additional model capacity or costly embodiment-specific pretraining. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-10 in cs.AI). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM). Pagina del lavoro: https://arxiv.org/abs/2609.10522 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T07:00:16.418Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).