Metraipolis › archive › dc_c81bf2e7aa51

Sharing the Control Authority Between Deep Reinforcement Learning and Model Predictive Control: Application to Multi-Class Transportation Networks — arXiv:2608.20858

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.20858
License (as archived)
CC0-1.0
Archived
2026-10-18T10:31:29.241Z
SHA-256 of the archived text
10f34c21b037dff6c94bdae43bda527780d017c9b39d51322bdc65bb0597ab23
Stable URL of this page
https://metraipolis.com/documento/dc_c81bf2e7aa51

How to cite

Sharing the Control Authority Between Deep Reinforcement Learning and Model Predictive Control: Application to Multi-Class Transportation Networks — arXiv:2608.20858 — arXiv (en), https://arxiv.org/abs/2608.20858 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c81bf2e7aa51 (Metraipolis archive dc_c81bf2e7aa51, sha256 10f34c21b037dff6c94bdae43bda527780d017c9b39d51322bdc65bb0597ab23)
BibTeX
@misc{dcc81bf2e7aa51,
  title = {Sharing the Control Authority Between Deep Reinforcement Learning and Model Predictive Control: Application to Multi-Class Transportation Networks — arXiv:2608.20858},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.20858},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c81bf2e7aa51; sha256 10f34c21b037dff6c94bdae43bda527780d017c9b39d51322bdc65bb0597ab23},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.20858. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Transportation networks, in particular multi-class transportation networks (i.e., networks with mixed vehicle types), are complex systems that are challenging to control. Recently, Deep Reinforcement Learning (DRL), which learns control policies from interactions with the environment, and Model Predictive Control (MPC), which uses a system model to optimize control inputs, have been increasingly utilized for transportation network control. However, nonlinear system dynamics and high-dimensional state spaces in large-scale networks limit DRL's learning capacity under time-constrained training and increase MPC's computation time, hindering real-time implementation with limited computational resources. Moreover, MPC depends on an accurate network model, which is often unavailable for complex systems such as multi-class transportation networks. This paper proposes a novel DRL-MPC framework for multi-class transportation networks that divides control authority between DRL and MPC, combining DRL's fast online computation and model independence with MPC's built-in optimization and constraint-handling capabilities. In the hierarchical framework, MPC operates at the higher level and determines low-frequency control inputs whose slower update rate accommodates its high computation time, while DRL operates at the lower level and determines high-frequency control inputs using its fast online deployment. The framework is evaluated on a multi-class freeway network against a hierarchical MPC controller and a hybrid state-feedback-MPC controller, including scenarios with model mismatch and noisy traffic demands. Results show that the proposed framework outperforms the hybrid state-feedback-MPC controller, substantially reduces online computation time compared with the hierarchical MPC controller, and provides more effective constraint enforcement under model mismatch.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-24 in cs.LG).
Categorie arXiv: Systems and Control (eess.SY) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.20858 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T10:27:55.995Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).