Metraipolis › archive › dc_3ef703b8cc0a

Rendering-Free Lookahead for Question-Guided Active Vision — arXiv:2610.11039

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.11039
License (as archived)
CC0-1.0
Archived
2026-10-09T06:30:14.764Z
SHA-256 of the archived text
1fc0920937c3bcde48a981ddf3c592b05dce6e5be75909d90b2be00e22442a04
Stable URL of this page
https://metraipolis.com/documento/dc_3ef703b8cc0a

How to cite

Rendering-Free Lookahead for Question-Guided Active Vision — arXiv:2610.11039 — arXiv (en), https://arxiv.org/abs/2610.11039 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3ef703b8cc0a (Metraipolis archive dc_3ef703b8cc0a, sha256 1fc0920937c3bcde48a981ddf3c592b05dce6e5be75909d90b2be00e22442a04)
BibTeX
@misc{dc3ef703b8cc0a,
  title = {Rendering-Free Lookahead for Question-Guided Active Vision — arXiv:2610.11039},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.11039},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3ef703b8cc0a; sha256 1fc0920937c3bcde48a981ddf3c592b05dce6e5be75909d90b2be00e22442a04},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.11039. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Active robot vision requires controlling the camera to reveal task-relevant information that is hidden from the current viewpoint. For example, determining what is inside a box may require raising the camera and looking down into it. For viewpoint-dependent question answering, the challenge is to select camera motions that expose the visual evidence needed to answer the question. Although vision-language models (VLMs) can interpret observed images, selecting such motions requires anticipating the usefulness of unseen views. We quantify this usefulness as answerability, a VLM's estimate that a view suffices to answer the question, and present Rendering-Free Lookahead (RFL), a viewpoint-selection policy that ranks candidate camera motions by predicted future answerability. RFL transfers visual lookahead from deployment to offline training. At training, a privileged teacher renders candidate future views in 3D Gaussian Splatting (3DGS) scenes and uses a frozen VLM to compute one- and two-step answerability targets. Through two-stage distillation, a student learns to predict these action values from the question, recent visual observations, and a candidate camera motion. At deployment, RFL uses these predicted values to select camera motions without rendering future views. On 377 E3VS-Bench test episodes in unseen environments, RFL improves the mean judge score by 43\% over a direct-action baseline using the same VLM. These results support learning camera-control policies from privileged visual lookahead for viewpoint-dependent question answering.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2610.11039 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T05:55:07.012Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).