Metraipolis › archive › dc_f88a07d51978

CoGenRec: A Unified Generative Framework for Complementary Vision Reconstruction — arXiv:2611.07665

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.07665
License (as archived)
CC0-1.0
Archived
2026-11-06T14:53:29.277Z
SHA-256 of the archived text
0736d715aa8878665bea5b2b77c72513371002c9a9465d981b912e125e2b120e
Stable URL of this page
https://metraipolis.com/documento/dc_f88a07d51978

How to cite

CoGenRec: A Unified Generative Framework for Complementary Vision Reconstruction — arXiv:2611.07665 — arXiv (en), https://arxiv.org/abs/2611.07665 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f88a07d51978 (Metraipolis archive dc_f88a07d51978, sha256 0736d715aa8878665bea5b2b77c72513371002c9a9465d981b912e125e2b120e)
BibTeX
@misc{dcf88a07d51978,
  title = {CoGenRec: A Unified Generative Framework for Complementary Vision Reconstruction — arXiv:2611.07665},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.07665},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f88a07d51978; sha256 0736d715aa8878665bea5b2b77c72513371002c9a9465d981b912e125e2b120e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.07665. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Capturing scenes with extreme motion and high dynamic range is fundamentally constrained by trade-offs among temporal resolution, spatial detail, signal-to-noise ratio, and dynamic range under practical bandwidth, power, and quantum-efficiency limits. Conventional frame-based cameras therefore suffer from temporal undersampling, exposure-induced motion blur, and sensor saturation. The Complementary Vision Sensor (CVS) addresses these limitations by decomposing visual information across two complementary pathways, a spatially dense, temporally sparse, long-exposure RGB pathway and a temporally dense, spatially sparse, short-exposure patiotemporal difference pathway. Their complementary measurements provide appearance, structural, and motion cues across a wide dynamic range that enable reconstruction beyond conventional imaging. We present CoGenRec, a complementarity-driven generative reconstruction framework that unifies video deblurring, high-temporal-resolution frame interpolation, and HDR fusion. CoGenRec encodes complementary measurements into multi-scale spatiotemporal features using exposure-aware appearance modeling and bidirectional temporal propagation. These features constrain a video diffusion model and are injected into the VAE decoder to recover fine structures lost during latent-space compression, combining the scene fidelity of physical measurements with the appearance recovery capabilities of learned video priors. On SportsSloMo-CVS, CoGenRec improves PSNR over the strongest general-purpose baseline by 4.40 dB for deblurring, 3.89 dB for frame interpolation, and 5.04 dB for HDR fusion, respectively. It also achieves strong perceptual quality on 129 unseen scenes captured with real CVS. These results establish a unified approach to advance high-quality reconstruction under challenging motion and illumination conditions. Project page: this https URL .

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2611.07665 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-06T14:25:42.614Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).