Metraipolis › archive › dc_e5b32f2faa76
HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes — arXiv:2611.02752
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.02752
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T18:28:36.359Z
- SHA-256 of the archived text
f5089ec2724f09614ec14e9a192c2e085e9db921c9abb933f02a871886df00f4- Stable URL of this page
https://metraipolis.com/documento/dc_e5b32f2faa76
How to cite
HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes — arXiv:2611.02752 — arXiv (en), https://arxiv.org/abs/2611.02752 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e5b32f2faa76 (Metraipolis archive dc_e5b32f2faa76, sha256 f5089ec2724f09614ec14e9a192c2e085e9db921c9abb933f02a871886df00f4)
BibTeX
@misc{dce5b32f2faa76,
title = {HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes — arXiv:2611.02752},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.02752},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e5b32f2faa76; sha256 f5089ec2724f09614ec14e9a192c2e085e9db921c9abb933f02a871886df00f4},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02752. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large Language Models (LLMs) have shown strong capabilities in code generation and reasoning, motivating extensive benchmarks for evaluating functional correctness. However, performance optimization in High-Performance Computing (HPC) poses fundamentally different challenges that are not captured by existing evaluations: HPC performance depends on low-level code, intricate memory access patterns, and computational kernels embedded within sophisticated execution contexts. We introduce HPC-Bench, a performance-grounded benchmark for evaluating LLMs as optimizers of computational kernels in realistic HPC workloads, including 114 workloads across 16 HPC computational motifs. HPC-Bench provides a fully automated, end-to-end evaluation pipeline that combines program-level correctness verification with two correctness-gated metrics, Fast@k and Speedup@k, to characterize reliability and speedup under a fixed sampling budget. Our evaluation of three representative LLMs across serial CPU, OpenMP, and CUDA settings shows that stricter speedup requirements substantially reduce the probability of finding a correct and fast optimization. HPC-Bench is available at this https URL . Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.PF, nuovi lavori del giorno). Categorie arXiv: Performance (cs.PF). Pagina del lavoro: https://arxiv.org/abs/2611.02752 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T18:10:53.310Z dalla pagina https://arxiv.org/list/cs.PF/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).