Metraipolis › archive › dc_ad5d045c2a34
Evaluating Runtime Prediction and Conservative Walltime Policies in HPC Systems — arXiv:2610.27755
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.27755
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-21T07:11:22.897Z
- SHA-256 of the archived text
5b1313b765fcd39426227d941b9b43741983a2f9b9f491dbcb8ce65f624d1557- Stable URL of this page
https://metraipolis.com/documento/dc_ad5d045c2a34
How to cite
Evaluating Runtime Prediction and Conservative Walltime Policies in HPC Systems — arXiv:2610.27755 — arXiv (en), https://arxiv.org/abs/2610.27755 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ad5d045c2a34 (Metraipolis archive dc_ad5d045c2a34, sha256 5b1313b765fcd39426227d941b9b43741983a2f9b9f491dbcb8ce65f624d1557)
BibTeX
@misc{dcad5d045c2a34,
title = {Evaluating Runtime Prediction and Conservative Walltime Policies in HPC Systems — arXiv:2610.27755},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.27755},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ad5d045c2a34; sha256 5b1313b765fcd39426227d941b9b43741983a2f9b9f491dbcb8ce65f624d1557},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.27755. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Efficient use of large-scale supercomputing systems depends on accurate runtime estimation and walltime selection. To avoid premature termination, users often overestimate walltime, leading to poor resource utilization and reduced scheduling efficiency. This paper presents a predictor-agnostic framework for safe walltime recommendation in production HPC environments. Rather than proposing a new runtime prediction model, the primary contribution is the SAFE decision layer, which converts predicted runtimes into conservative bounded walltime recommendations suitable for deployment. Runtime prediction is therefore treated as a modular component within the proposed framework. We evaluate the approach using large-scale production job histories from the Fugaku and NREL Eagle supercomputers, comprising approximately 24M and 11M jobs, respectively. Runtime prediction performance is first evaluated using representative predictors, including linear regression, neural networks, and a neural ensemble. The proposed SAFE framework is then evaluated using the NN ensemble predictor. Experimental results indicate that similarity-aware prediction substantially improves runtime estimation for workloads similar to previous executions. When combined with the proposed conservative walltime recommendation policies, these improvements enable walltime gap reductions of approximately 20 - 26% while maintaining job termination rates below 1% across both systems. Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.DC, nuovi lavori del giorno). Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC). Pagina del lavoro: https://arxiv.org/abs/2610.27755 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-21T07:06:13.127Z dalla pagina https://arxiv.org/list/cs.DC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).