Metraipolis › archive › dc_dbf27eaea4f1

VLCP: Vision Language Control Policy Closed-Loop Code Replanning for Robot Manipulation — arXiv:2608.16978

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.16978
License (as archived)
CC0-1.0
Archived
2026-10-18T14:48:55.509Z
SHA-256 of the archived text
1fb262c7a28d14edd1f5e1f7078c8c1d582c60c510a840eb521cb07d1fe6cb80
Stable URL of this page
https://metraipolis.com/documento/dc_dbf27eaea4f1

How to cite

VLCP: Vision Language Control Policy Closed-Loop Code Replanning for Robot Manipulation — arXiv:2608.16978 — arXiv (en), https://arxiv.org/abs/2608.16978 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_dbf27eaea4f1 (Metraipolis archive dc_dbf27eaea4f1, sha256 1fb262c7a28d14edd1f5e1f7078c8c1d582c60c510a840eb521cb07d1fe6cb80)
BibTeX
@misc{dcdbf27eaea4f1,
  title = {VLCP: Vision Language Control Policy Closed-Loop Code Replanning for Robot Manipulation — arXiv:2608.16978},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.16978},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_dbf27eaea4f1; sha256 1fb262c7a28d14edd1f5e1f7078c8c1d582c60c510a840eb521cb07d1fe6cb80},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.16978. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Turning a frontier vision-language model into a robot policy usually means fine-tuning it to emit an action representation it never saw in pretraining, which throws away much of the reasoning that made the model worth reaching for. We go the other way and keep the VLM frozen. It writes the policy as a short Python control function, with no demonstrations and no fine-tuning. Writing that code once is open-loop, though. Existing closed-loop methods react at the wrong level: they retry a fixed policy or pick a different subtask, but never rewrite the code that failed. VLCP closes the loop where the failure actually lives, on the control code, within a single episode. Every $K$ steps the VLM re-observes the scene from multi-view RGB, proprioceptive state, and a state delta, then rewrites the control function from what it just saw, so a failure is caught before it compounds. We evaluate on a 57-task MuJoCo/RoboVerse sweep. This training-free policy reaches $35.1\%$ pooled success, against $3.5\%$ for the identical system queried once per episode. That tenfold gap holds with non-overlapping confidence intervals in every scene family. The gain traces to a $27.3\%$ within-episode recovery rate on failed grasps: a miss an open-loop controller would carry to the end of the episode gets re-observed and fixed at the next replan. And the loop stays cheap. A median $84\%$ of input tokens hit cache, an episode needs only about $10$ compact queries, and control blocks written during any replan persist to a cross-episode skill library reused in later prompts.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-19 in cs.LG).
Categorie arXiv: Robotics (cs.RO) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.16978 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T14:47:59.443Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-19?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).