Metraipolis › archive › dc_63d483eee4fe

Be My Eye: Learning to See Beyond a Robot's Own Perspective — arXiv:2611.12295

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.12295
License (as archived)
CC0-1.0
Archived
2026-11-10T18:44:01.489Z
SHA-256 of the archived text
e115d62437b68f56cb77a2c7726bad41ea26a5f27fff97f46c69f3efd2990c9a
Stable URL of this page
https://metraipolis.com/documento/dc_63d483eee4fe

How to cite

Be My Eye: Learning to See Beyond a Robot's Own Perspective — arXiv:2611.12295 — arXiv (en), https://arxiv.org/abs/2611.12295 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_63d483eee4fe (Metraipolis archive dc_63d483eee4fe, sha256 e115d62437b68f56cb77a2c7726bad41ea26a5f27fff97f46c69f3efd2990c9a)
BibTeX
@misc{dc63d483eee4fe,
  title = {Be My Eye: Learning to See Beyond a Robot's Own Perspective — arXiv:2611.12295},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.12295},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_63d483eee4fe; sha256 e115d62437b68f56cb77a2c7726bad41ea26a5f27fff97f46c69f3efd2990c9a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.12295. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Robots operating in the real world are inherently subject to partial observability, particularly in multi-robot collaboration, where individual observations may be insufficient for effective task execution. A key challenge is leveraging complementary observations from partner robots to support collaborative decision-making. We argue that information sharing should go beyond passively transmitting raw observations or generic visual features. Instead, robots should selectively encode task-relevant information according to task objectives and execution progress. To this end, we propose a task-oriented active context sharing framework that transforms robot observations into compact representations, preserving critical information under constrained communication budgets. The framework adopts a two-stage training paradigm. In the first stage, onboard observations and task instructions are jointly encoded into compact context representations. Task-oriented future prediction and soft task-progress correspondence learning guide this collaboration-agnostic compression, preserving information about task objectives and execution progress. In the second stage, the learned representations are integrated into a pretrained Vision-Language-Action (VLA) policy, enabling bidirectional context exchange. Each robot combines complementary partner information with local observations to guide action generation. Action supervision jointly refines the context representations and policy, aligning information sharing with collaborative decision-making. Controlled experiments demonstrate substantial performance gains under constrained communication budgets, while three real-world experiments validate the framework in complex dual-robot tasks. These results highlight a shift from passive visual transmission toward active, task-oriented context sharing that directly supports collaborative decision-making.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.12295 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-10T18:37:37.686Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).