Metraipolis › archive › dc_fa6f5bc70828
BEE: Intervention-Adaptive Real-World Reinforcement Learning with Vision-Language-Action Models — arXiv:2609.27450
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.27450
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T09:12:38.510Z
- SHA-256 of the archived text
c82c7092950dd912a8e1f80a626e0f0405da6baf602a4540be42fe741da32c04- Stable URL of this page
https://metraipolis.com/documento/dc_fa6f5bc70828
How to cite
BEE: Intervention-Adaptive Real-World Reinforcement Learning with Vision-Language-Action Models — arXiv:2609.27450 — arXiv (en), https://arxiv.org/abs/2609.27450 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fa6f5bc70828 (Metraipolis archive dc_fa6f5bc70828, sha256 c82c7092950dd912a8e1f80a626e0f0405da6baf602a4540be42fe741da32c04)
BibTeX
@misc{dcfa6f5bc70828,
title = {BEE: Intervention-Adaptive Real-World Reinforcement Learning with Vision-Language-Action Models — arXiv:2609.27450},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.27450},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fa6f5bc70828; sha256 c82c7092950dd912a8e1f80a626e0f0405da6baf602a4540be42fe741da32c04},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.27450. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Vision-language-action (VLA) models handle long-horizon manipulation, yet success hinges on a few precision-critical phases where millimeter-scale errors undo all prior progress. Online reinforcement learning (RL) can optimize exactly these actions, but free exploration is far too costly on real robots, which makes human corrections indispensable. However, existing online RL methods for VLAs either cannot incorporate such corrections or fold them into undifferentiated supervision. Yet human corrections are not uniformly noisy but reliable along some action dimensions and variable along others. Building on this, we introduce BEE, an intervention-adaptive framework for real-world RL on a frozen VLA that lets the policy go BEyond Expert imitation. We formulate human corrections not as actions to reproduce but as evidence about a constraint: a Correction Model predicts how a human would correct a given VLA proposal and how consistent the correction is along each action dimension. This predicted consistency sets the per-dimension tightness of a constraint on policy optimization. Where corrections are consistent the policy stays close to the human, and where they vary, the constraint relaxes. We evaluate BEE on three real-world manipulation tasks and one LIBERO-Pro simulation task at a matched online-data budget. BEE attains the highest success rate on every task, 91.2% on average against 57.5% for RLT and 42.1% for DSRL, and the lowest human intervention rate on all real-world tasks. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-24 in cs.AI). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.27450 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T08:13:26.679Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).