Metraipolis › archive › dc_db98ed6bf6ef
Localizing and Editing the Goal Representation of a Vision-Language-Action Model — arXiv:2611.08895
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.08895
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-09T22:45:56.062Z
- SHA-256 of the archived text
3485de00d66a83f39f80128522be987ab6c7da831e5b636458ac7d8e44b47ab3- Stable URL of this page
https://metraipolis.com/documento/dc_db98ed6bf6ef
How to cite
Localizing and Editing the Goal Representation of a Vision-Language-Action Model — arXiv:2611.08895 — arXiv (en), https://arxiv.org/abs/2611.08895 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_db98ed6bf6ef (Metraipolis archive dc_db98ed6bf6ef, sha256 3485de00d66a83f39f80128522be987ab6c7da831e5b636458ac7d8e44b47ab3)
BibTeX
@misc{dcdb98ed6bf6ef,
title = {Localizing and Editing the Goal Representation of a Vision-Language-Action Model — arXiv:2611.08895},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.08895},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_db98ed6bf6ef; sha256 3485de00d66a83f39f80128522be987ab6c7da831e5b636458ac7d8e44b47ab3},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.08895. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Operators can state safety constraints for robots as prohibitions such as "do not put the bowl on the stove". We study whether OpenVLA follows such prohibitions and where it represents the goal it executes. The 10 tasks of LIBEROGoal share one scene, so we can label the goal that each rollout executes. We combine closed-loop rollouts with activation patching, linear probes, activation steering and runtime monitors. On LIBERO-Goal, negation had no detectable effect on which task OpenVLA executed. The model executed the forbidden task in 79% of negated rollouts and completed 78% of plain tasks. A goal probe gives similar read-outs under "not X" and "X". Activation patching shows that the first action depends mostly on the instruction tokens before layer 12 and on the last prompt token from layer 16 onward. A fixed steering vector at the instruction tokens at layer 8 redirected 12 of 18 rollouts. Fixed vectors and prefill patches at layers 12 to 20 redirected none of 158. From layer 16, only patches at every decoded action token redirected the robot (15 of 18 rollouts at layer 24). When the instruction changes during a rollout, the layer-32 goal read-out detects non-compliance better than failure detectors, and an external probe on image and instruction features performs comparably. These results support enforcing prohibitions outside the instruction and monitoring goal read-outs against the specification. Goal edits in OpenVLA should act before layer 12 or patch every action token. Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.RO, nuovi lavori del giorno). Categorie arXiv: Robotics (cs.RO). Pagina del lavoro: https://arxiv.org/abs/2611.08895 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-09T22:38:02.164Z dalla pagina https://arxiv.org/list/cs.RO/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).