Metraipolis › archive › dc_b73bec6334e8

Representation-Guided Generation and Integration of Executable Programs for Robot Manipulation — arXiv:2609.31337

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.31337
License (as archived)
CC0-1.0
Archived
2026-10-08T03:15:04.025Z
SHA-256 of the archived text
458f00d9c9095c10247624883979c6334ad9b66ba1bf100fee59d5b6a4a53a36
Stable URL of this page
https://metraipolis.com/documento/dc_b73bec6334e8

How to cite

Representation-Guided Generation and Integration of Executable Programs for Robot Manipulation — arXiv:2609.31337 — arXiv (en), https://arxiv.org/abs/2609.31337 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b73bec6334e8 (Metraipolis archive dc_b73bec6334e8, sha256 458f00d9c9095c10247624883979c6334ad9b66ba1bf100fee59d5b6a4a53a36)
BibTeX
@misc{dcb73bec6334e8,
  title = {Representation-Guided Generation and Integration of Executable Programs for Robot Manipulation — arXiv:2609.31337},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.31337},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b73bec6334e8; sha256 458f00d9c9095c10247624883979c6334ad9b66ba1bf100fee59d5b6a4a53a36},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.31337. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Building a robotic manipulation system requires connecting perception, planning, and control through carefully designed representations and interfaces. VLM code generation offers a way to automate this construction, but independently generated components may operate on incompatible geometric and task-level information. We present Representation-guided Integration of VLM-generated Executable Task programs (RIVET), a framework for generating complete manipulation systems around a shared object-centric representation. The representation combines per-object 6D poses, which preserve the metric information required for action grounding, with a relation graph that exposes the task-level structure required for planning. Guided by this representation, a VLM generates cooperating perception, rendering, relation-inference, and planning programs, each combining task-specific computation with available packages where useful. The resulting programs are authored once for a manipulation domain and reused on unseen start and goal configurations without code regeneration. We evaluate RIVET on cube stacking, tangram rearrangement, and three-dimensional assembly in simulation and on a physical robot, where we achieve 83% overall success rate in the real world by reusing offline-generated systems. Our results demonstrate that representation-guided program generation can adapt a common manipulation framework to tasks with different geometric, relational, and sequential requirements.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-28 in cs.RO).
Categorie arXiv: Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.31337 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T02:58:08.951Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).