Metraipolis › archive › dc_448f45835616
RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedback — arXiv:2609.09828
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.09828
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T11:00:13.480Z
- SHA-256 of the archived text
e0ae7cc5f3913b9ea1e9eaf1c2b31ecfeae7f9f7b332ac87129f9d4d4ab8ded5- Stable URL of this page
https://metraipolis.com/documento/dc_448f45835616
How to cite
RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedback — arXiv:2609.09828 — arXiv (en), https://arxiv.org/abs/2609.09828 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_448f45835616 (Metraipolis archive dc_448f45835616, sha256 e0ae7cc5f3913b9ea1e9eaf1c2b31ecfeae7f9f7b332ac87129f9d4d4ab8ded5)
BibTeX
@misc{dc448f45835616,
title = {RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedback — arXiv:2609.09828},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.09828},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_448f45835616; sha256 e0ae7cc5f3913b9ea1e9eaf1c2b31ecfeae7f9f7b332ac87129f9d4d4ab8ded5},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.09828. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Real-world observations of deformable objects are often sparse or surface-level, while downstream tasks require hidden physical quantities such as internal deformation, stress fields, and interaction forces. Physics-based simulation can recover these quantities, but online real-to-sim adaptation remains challenging due to costly full-space optimization, limited feedback, and time-varying material properties. To address these challenges, we propose RealSimLoop, a differentiable framework for online real-to-sim adaptation using vision data as physical feedback. Our approach achieves quasi-real-time performance by executing differentiable simulation within a reduced-order neural subspace, drastically accelerating the optimization loop. We couple this efficient dynamics model with differentiable rendering, enabling direct gradient backpropagation that leverages high-fidelity pixel data to refine physical parameters such as material stiffness. Furthermore, by employing a sliding-window objective function, RealSimLoop enables robust online adaptation, allowing the system to track time-varying material properties and effectively bridge the real-to-sim gap arising from model reduction or unmodeled dynamics. Extensive experiments demonstrate that our method outperforms conventional offline methods, and we validate the framework's versatility in downstream applications, including external force prediction and 3D stress field reconstruction with novel view synthesis. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-10 in cs.CV). Categorie arXiv: Graphics (cs.GR) ; Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO). Pagina del lavoro: https://arxiv.org/abs/2609.09828 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T10:02:34.432Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).