Metraipolis › archive › dc_80ae372ef138

Composite-Gradient Learning for Shared Control Authority Between Deep Reinforcement Learning and Model Predictive Control — arXiv:2609.17697

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.17697
License (as archived)
CC0-1.0
Archived
2026-10-15T15:04:24.078Z
SHA-256 of the archived text
5b7131e9d66a0157f9a98f19fa2861d3c4ddd8c6d44bdf2f0fff2b61a5a912de
Stable URL of this page
https://metraipolis.com/documento/dc_80ae372ef138

How to cite

Composite-Gradient Learning for Shared Control Authority Between Deep Reinforcement Learning and Model Predictive Control — arXiv:2609.17697 — arXiv (en), https://arxiv.org/abs/2609.17697 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_80ae372ef138 (Metraipolis archive dc_80ae372ef138, sha256 5b7131e9d66a0157f9a98f19fa2861d3c4ddd8c6d44bdf2f0fff2b61a5a912de)
BibTeX
@misc{dc80ae372ef138,
  title = {Composite-Gradient Learning for Shared Control Authority Between Deep Reinforcement Learning and Model Predictive Control — arXiv:2609.17697},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.17697},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_80ae372ef138; sha256 5b7131e9d66a0157f9a98f19fa2861d3c4ddd8c6d44bdf2f0fff2b61a5a912de},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.17697. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Integrated deep reinforcement learning (DRL) and model predictive control (MPC) methods are increasingly used to control autonomous systems by combining their complementary capabilities. DRL learns control policies through interaction with the environment. MPC uses a system model to optimize control inputs while accounting for constraints. In DRL-MPC frameworks with shared control authority, both the DRL agent and the MPC controller each determine part of the control inputs. However, common learning formulations treat MPC as part of the environment and therefore do not explicitly account for MPC's contribution to control or its interaction with the DRL agent. This paper proposes a novel composite-gradient learning (CGL) method that integrates the MPC controller into the learning process by representing the DRL and MPC control inputs as a joint action and accounting for their interaction when updating the DRL agent during training. CGL is evaluated on two multi-class freeway traffic networks with different strengths of interaction between the DRL and MPC control inputs and it is compared with alternative methods that treat MPC as part of the environment or that only partially incorporate MPC into learning. The results show that CGL offers limited benefit under weak interaction, but learns higher-performing control policies than the alternative methods in a subset of training runs under strong interaction, although the average control-performance gains remain modest.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-17 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG) ; Systems and Control (eess.SY).
Pagina del lavoro: https://arxiv.org/abs/2609.17697 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T14:08:19.060Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).