Metraipolis › archive › dc_d9969a6fc641
Leveraging Human-In-The-Loop Demonstrations in Reinforcement Learning for Digital Twin-Driven Robot Flexibility — arXiv:2610.12140
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.12140
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-09T06:35:25.637Z
- SHA-256 of the archived text
6677001592550c7f192b0a4b355b81995b1f6cc9f4dcbc221945c83ad0a1f0cc- Stable URL of this page
https://metraipolis.com/documento/dc_d9969a6fc641
How to cite
Leveraging Human-In-The-Loop Demonstrations in Reinforcement Learning for Digital Twin-Driven Robot Flexibility — arXiv:2610.12140 — arXiv (en), https://arxiv.org/abs/2610.12140 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d9969a6fc641 (Metraipolis archive dc_d9969a6fc641, sha256 6677001592550c7f192b0a4b355b81995b1f6cc9f4dcbc221945c83ad0a1f0cc)
BibTeX
@misc{dcd9969a6fc641,
title = {Leveraging Human-In-The-Loop Demonstrations in Reinforcement Learning for Digital Twin-Driven Robot Flexibility — arXiv:2610.12140},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.12140},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d9969a6fc641; sha256 6677001592550c7f192b0a4b355b81995b1f6cc9f4dcbc221945c83ad0a1f0cc},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.12140. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Growing automation makes collaborative robots work in more variable environments, increasing the need for adaptation. We propose a human-in-the-loop online training framework combining a digital twin (DT), reinforcement learning (RL), and human demonstrations. Unlike DTs used mainly to generate synthetic data before task execution, our DT is synchronized with the physical system in real time through camera feeds, allowing the virtual robot to update its observations and policy from real-world feedback. A dual actor framework integrates imitation learning (IL) without adding a direct imitation loss to the RL actor, so demonstrations can guide adaptation instead of manual reprogramming. The proposed framework is demonstrated on the Ufactory Xarm5 collaborative robot, where the robot's end-effector aims to reach the target position while avoiding obstacles. The experiments show that the framework can resume training after a change in the physical workspace and that, with a fixed set of non-optimal demonstrations, the dual actor framework achieves a much higher final success rate than two methods that add an imitation loss to the actor. The same pattern holds with real human demonstrations collected in virtual reality (VR): with demonstrations that never reach the goal, the dual actor framework reached 83-100% mean deterministic evaluation success, against 0-17% for the two imitation-loss methods. Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.RO, nuovi lavori del giorno). Categorie arXiv: Robotics (cs.RO) ; Systems and Control (eess.SY). Pagina del lavoro: https://arxiv.org/abs/2610.12140 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-09T05:55:22.205Z dalla pagina https://arxiv.org/list/cs.RO/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).