Metraipolis › archive › dc_a155bec402cf

Digital Twin-Driven Real2Sim2Real: Simulator-Conditioned Generation via Paired Driving-Scene Reconstruction — arXiv:2610.08339

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.08339
License (as archived)
CC0-1.0
Archived
2026-10-07T13:07:36.272Z
SHA-256 of the archived text
3e7e41c93b99847c7e70d625ecab6902a8b00a4dde39cda7d008b064302bc6a6
Stable URL of this page
https://metraipolis.com/documento/dc_a155bec402cf

How to cite

Digital Twin-Driven Real2Sim2Real: Simulator-Conditioned Generation via Paired Driving-Scene Reconstruction — arXiv:2610.08339 — arXiv (en), https://arxiv.org/abs/2610.08339 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a155bec402cf (Metraipolis archive dc_a155bec402cf, sha256 3e7e41c93b99847c7e70d625ecab6902a8b00a4dde39cda7d008b064302bc6a6)
BibTeX
@misc{dca155bec402cf,
  title = {Digital Twin-Driven Real2Sim2Real: Simulator-Conditioned Generation via Paired Driving-Scene Reconstruction — arXiv:2610.08339},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.08339},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a155bec402cf; sha256 3e7e41c93b99847c7e70d625ecab6902a8b00a4dde39cda7d008b064302bc6a6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.08339. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Camera-based 3D perception for autonomous driving relies heavily on large annotated datasets, and deploying such a system to a new target region typically requires data collection and annotation. Generative augmentation has been proposed to reduce this cost, but existing approaches face a fundamental trade-off: label-conditioned methods consume the very annotations they aim to replace, while simulator-conditioned methods offer free annotations but lack visual grounding to specific real environments. This work investigates the extent to which a digital-twin-driven Real2Sim2Real pipeline (DT-R2S2R) can substitute for target-region real data. By reconstructing recorded driving clips inside a georeferenced digital twin (DT-R2S), we condition a diffusion model on geometrically aligned simulator renderings, establishing a digital twin-grounded Sim2Real model (DT-S2R). As a result, DT-S2R synthesizes photorealistic driving images given low-cost yet georeferenced simulator data across both reconstructed and novel simulator scenes within digital-twin coverage. The efficacy of generated data is verified on diverse 3D detectors. DETR3D, especially, reports 93.18% of mAP obtained by a target-region real-data oracle, without employing target images for detector training. Furthermore, simple co-training with existing out-of-target real data outperforms the oracle. Thus, DT-R2S2R can substantially reduce the cost of manual on-site data collection and annotation in digital twin-available districts, providing a practical foundation for scaling 3D perception.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2610.08339 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T12:37:32.971Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).