Metraipolis › archive › dc_3fb04cbebbe6
Distilling Instructions into Weights: Closed-Form Edits Fix a Robot Policy's Misreading — arXiv:2611.11894
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.11894
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-10T18:43:44.722Z
- SHA-256 of the archived text
79e94c53674e646f1b1c6f6d081deeed2f36f3ad4b6204cb63809c702150bd8d- Stable URL of this page
https://metraipolis.com/documento/dc_3fb04cbebbe6
How to cite
Distilling Instructions into Weights: Closed-Form Edits Fix a Robot Policy's Misreading — arXiv:2611.11894 — arXiv (en), https://arxiv.org/abs/2611.11894 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3fb04cbebbe6 (Metraipolis archive dc_3fb04cbebbe6, sha256 79e94c53674e646f1b1c6f6d081deeed2f36f3ad4b6204cb63809c702150bd8d)
BibTeX
@misc{dc3fb04cbebbe6,
title = {Distilling Instructions into Weights: Closed-Form Edits Fix a Robot Policy's Misreading — arXiv:2611.11894},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.11894},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3fb04cbebbe6; sha256 79e94c53674e646f1b1c6f6d081deeed2f36f3ad4b6204cb63809c702150bd8d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.11894. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Generalist robot policies often fail at one step of a task they can otherwise perform. We ask whether such a failure can be repaired by editing the policy's weights directly, without gradients, training data, or a change to the instruction. Told to put the cube then the banana in the bowl, a zero-shot $\pi_{0.5}$ vision-language-action policy in RoboLab releases the cube before it reaches the bowl. Replaying 21 of these decisions under rewordings shows that it binds "in the bowl" to the wrong object. Closed-form instruction distillation copies the per-layer effect of an explicit rewording into the language model's MLP weights. On 128 held-out seeds, success rises from 27 to 106 episodes, with 81 fixed and 2 broken ($p=7\times10^{-22}$), while an update of the same size in random directions leaves success unchanged. The edit also lifts two other tasks without detectable harm on the remaining 13, and a variant that stores 0.16% of the parameter count keeps most of its effect. Placed in the action expert or action head instead, the same distillation helps less or not at all. Our released tool reproduced the fix end to end on new held-out seeds, from 8/64 to 36/64. Edits aimed at perception, a missing grasp, contact physics, or the gripper threshold did not help, and of seven blind Claude Opus editors, only the one given the misread instruction produced an edit that passed held-out scoring. These results suggest that weight edits work best when a known-good input already exists to distil. Because reruns with unchanged weights flip about a third of paired outcomes, evaluations should pair seeds, rerun the unedited policy, and confirm gains on held-out seeds.
Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.11894 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-10T18:37:37.664Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).