Metraipolis › archive › dc_ac80751d6f27

TuneBench: Benchmarking AI Agents for Power System Dynamic Model Calibration — arXiv:2611.04640

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.04640
License (as archived)
CC0-1.0
Archived
2026-11-04T19:14:07.482Z
SHA-256 of the archived text
8044975be2e432731388d84202647c1ed340d6ce30b62c7cfc608a01ec30db32
Stable URL of this page
https://metraipolis.com/documento/dc_ac80751d6f27

How to cite

TuneBench: Benchmarking AI Agents for Power System Dynamic Model Calibration — arXiv:2611.04640 — arXiv (en), https://arxiv.org/abs/2611.04640 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ac80751d6f27 (Metraipolis archive dc_ac80751d6f27, sha256 8044975be2e432731388d84202647c1ed340d6ce30b62c7cfc608a01ec30db32)
BibTeX
@misc{dcac80751d6f27,
  title = {TuneBench: Benchmarking AI Agents for Power System Dynamic Model Calibration — arXiv:2611.04640},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.04640},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ac80751d6f27; sha256 8044975be2e432731388d84202647c1ed340d6ce30b62c7cfc608a01ec30db32},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.04640. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large Language Model (LLM)-based agents can automate complex engineering workflows by interacting with tools, interpreting feedback, and making iterative decisions. This paper introduces TuneBench, a benchmark for evaluating Agentic AI in power system dynamic model calibration, where controller parameters are adjusted to reproduce target dynamic responses. The benchmark reflects a common Transmission System Operator (TSO) practice, in which equivalent models used for Dynamic Security Assessment (DSA) are calibrated against measurements from grid-code compliance tests when proprietary models are unavailable. Two cases of increasing complexity are considered: the governor and Automatic Voltage Regulator (AVR) of a synchronous generator and the control system of a Battery Energy Storage System (BESS), both tuned against active-power and voltage step tests within a budget of 15 simulations. LLM-based agents are compared with random search and Genetic Algorithm (GA) baselines over 10 independent runs. Only the most advanced models, Opus 5.5 and GPT-6, accurately reproduce all target trajectories, with median R2 above 0.995 in every test and tracking errors up to two orders of magnitude lower than the baselines. The agent logs show that these agents autonomously extract dynamic performance indices, such as settling time and damping, and relate them to specific control parameters, decomposing the tuning problem into physically interpretable sub-problems. The benchmark is publicly available at this https URL .

Tema degli esploratori: calcolo e infrastrutture (elenco arXiv eess.SY, nuovi lavori del giorno).
Categorie arXiv: Systems and Control (eess.SY).
Pagina del lavoro: https://arxiv.org/abs/2611.04640 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-04T18:48:22.566Z dalla pagina https://arxiv.org/list/eess.SY/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).