Metraipolis › archive › dc_de676ff192fe

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation — arXiv:2609.02847

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.02847
License (as archived)
CC0-1.0
Archived
2026-10-17T05:50:19.944Z
SHA-256 of the archived text
be6aae46050d84f7b6ed51db776e259f4668d6cbbdc39a7391c49eecee7ad4b6
Stable URL of this page
https://metraipolis.com/documento/dc_de676ff192fe

How to cite

RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation — arXiv:2609.02847 — arXiv (en), https://arxiv.org/abs/2609.02847 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_de676ff192fe (Metraipolis archive dc_de676ff192fe, sha256 be6aae46050d84f7b6ed51db776e259f4668d6cbbdc39a7391c49eecee7ad4b6)
BibTeX
@misc{dcde676ff192fe,
  title = {RoGe: Novel View Synthesis via End-to-End Implicit Reconstruction and Generation — arXiv:2609.02847},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.02847},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_de676ff192fe; sha256 be6aae46050d84f7b6ed51db776e259f4668d6cbbdc39a7391c49eecee7ad4b6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.02847. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Novel view synthesis from sparse inputs requires both geometric grounding from the observed views and generative priors of unobserved regions, motivating recent hybrid methods that combine reconstruction and generation. However, existing methods bridge the two with rendered images or explicit 3D representations such as point maps or 3D Gaussians. Generation is thus conditioned on a lossy and imperfect projection of the scene, inheriting its errors, and reconstruction receives no signal from generation to correct them. We present RoGe, an end-to-end unified reconstruction and generation framework that removes this explicit bridge. It targets roaming within a scene anchored by sparse views: given a few posed images and a camera trajectory, it synthesizes a temporally coherent video along that trajectory. From the sparse input views, RoGe builds an implicit scene representation with a feed-forward reconstruction model, and queries it with camera rays to obtain per-view geometric features. These features are injected into a video diffusion model as conditioning, without any explicit 3D intermediate. Both modules are trained jointly, so the generation objective directly shapes its own geometric conditioning. We conduct extensive experiments, where RoGe outperforms reconstruction-based, generation-based, and hybrid baselines in terms of image-level quality and video-level temporal and geometric consistency. Ablations confirm that ray-queried implicit features outperform both raw reconstruction tokens and rendered RGB as conditioning, and that joint training brings further gains. Our code will be released on this https URL .

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-03 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.02847 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T05:25:58.172Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-03?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).