Metraipolis › archive › dc_6299fc4901e7
A Unified Dynamics Framework for Reinforcement Learning and Classical Control of a Six-DOF Pipeline-Tracking ROV in NVIDIA Isaac Sim — arXiv:2610.04949
- Source
- arXiv
- Original
- https://arxiv.org/abs/2610.04949
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-06T05:26:35.502Z
- SHA-256 of the archived text
636c5b706d5a3ce8af13e54331320475e2e990f77467fd95e39216df7a414770- Stable URL of this page
https://metraipolis.com/documento/dc_6299fc4901e7
How to cite
A Unified Dynamics Framework for Reinforcement Learning and Classical Control of a Six-DOF Pipeline-Tracking ROV in NVIDIA Isaac Sim — arXiv:2610.04949 — arXiv, https://arxiv.org/abs/2610.04949 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6299fc4901e7 (Metraipolis archive dc_6299fc4901e7, sha256 636c5b706d5a3ce8af13e54331320475e2e990f77467fd95e39216df7a414770)
BibTeX
@misc{dc6299fc4901e7,
title = {A Unified Dynamics Framework for Reinforcement Learning and Classical Control of a Six-DOF Pipeline-Tracking ROV in NVIDIA Isaac Sim — arXiv:2610.04949},
howpublished = {arXiv},
url = {https://arxiv.org/abs/2610.04949},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6299fc4901e7; sha256 636c5b706d5a3ce8af13e54331320475e2e990f77467fd95e39216df7a414770},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.04949. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Reinforcement learning controllers for underwater vehicles are usually trained against one physics representation and deployed against another, so reported performance does not always describe behavior outside training. This paper presents a pipeline-tracking architecture for a six-degree-of-freedom remotely operated vehicle (ROV) in which one Universal Scene Description (USD) scene supplies the real BlueROV2-Heavy mass, added-mass, damping, buoyancy, and thruster parameters to both halves of the system: a vectorized NumPy implementation of Fossen's marine-craft equations, and an interactive NVIDIA Isaac Sim deployment applying the identical equations as PhysX forces at every step. The Coriolis-centripetal term is the primary dynamics model in both branches; a controlled ablation on PPO and TRPO shows that including it does not destabilize either algorithm and modestly improves tracking, about 19 percent lower standoff RMS error for TRPO. Five reinforcement learning algorithms, PPO, soft actor-critic, TD3, DDPG, and TRPO, are trained against one environment, reward, and randomized evaluation harness through a checkpoint-compatibility layer scoring any policy with the same code. The pipeline is extended with six classical baselines, PID, sliding-mode, fuzzy logic, feedback linearization, model predictive control, and an adaptive neuro-fuzzy inference system, driven by the same guidance geometry and thruster allocation as the learned policies. Under Coriolis-enabled dynamics, PPO, TRPO, and feedback linearization reach the strongest combination of 100 percent success and competitive accuracy; PID, fuzzy control, and the neuro-fuzzy baseline also reach 100 percent success with looser tracking; DDPG and TD3 each show a specific, explainable failure mode rather than a general weakness of off-policy learning; and classical control remains a strong baseline against the best learned policies. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Systems and Control (eess.SY). Pagina del lavoro: https://arxiv.org/abs/2610.04949 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-06T05:24:05.947Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).