Metraipolis › archive › dc_a48fb2fe518b
From PID to Reinforcement Learning in Building HVAC Control: A Control-Architecture Review of Tuning Strategies, Formulations, and Deployment Trade-offs — arXiv:2611.03152
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.03152
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T18:38:52.543Z
- SHA-256 of the archived text
c21832968f643a2e6b36e4cdd34f68f1dd0bb425af546e893a5264b46c958150- Stable URL of this page
https://metraipolis.com/documento/dc_a48fb2fe518b
How to cite
From PID to Reinforcement Learning in Building HVAC Control: A Control-Architecture Review of Tuning Strategies, Formulations, and Deployment Trade-offs — arXiv:2611.03152 — arXiv (en), https://arxiv.org/abs/2611.03152 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a48fb2fe518b (Metraipolis archive dc_a48fb2fe518b, sha256 c21832968f643a2e6b36e4cdd34f68f1dd0bb425af546e893a5264b46c958150)
BibTeX
@misc{dca48fb2fe518b,
title = {From PID to Reinforcement Learning in Building HVAC Control: A Control-Architecture Review of Tuning Strategies, Formulations, and Deployment Trade-offs — arXiv:2611.03152},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.03152},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a48fb2fe518b; sha256 c21832968f643a2e6b36e4cdd34f68f1dd0bb425af546e893a5264b46c958150},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.03152. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
This paper reviews control architectures for building heating, ventilation and air-conditioning (HVAC) systems, addressing the tension among energy demand, occupant comfort and equipment operability, and situating proportional-integral-derivative (PID) regulation within a layered control stack that also includes rule-based and model-based supervisory control and data-driven reinforcement learning (RL). It examines the thermostat-PID layer from two-position and scheduled setpoint control through proportional, PI and PID regulation and their tuning, then formulates RL for building control as a Markov decision process. Its central contribution is a taxonomy of where RL meets PID: RL as a gain tuner for an existing loop, as a direct replacement for the regulatory controller, as a hybrid with model predictive control, and as supervisory setpoint and schedule generation. Across these classes, the review establishes that the physical loop remains invariant while the intervention point changes, and that the classes differ in their requirements for actuation authority, state information, modelling, commissioning and constraint handling. It further establishes that PID is inexpensive and well codified but limited by nonlinearity, time variation, discrete mode switching, loop interaction and slow plant dynamics, while RL's admissible position must be argued rather than assumed. The paper concludes that these architectures are not competing philosophies of control but nested points of attachment on one HVAC plant, with hybrid implementations possible, and that deployment trade-offs must be assessed according to the specific control interface and scaffolding required. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2611.03152 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T18:12:54.615Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).