Metraipolis › archive › dc_e5b32f2faa76

HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes — arXiv:2611.02752

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.02752
License (as archived)
CC0-1.0
Archived
2026-11-03T18:28:36.359Z
SHA-256 of the archived text
f5089ec2724f09614ec14e9a192c2e085e9db921c9abb933f02a871886df00f4
Stable URL of this page
https://metraipolis.com/documento/dc_e5b32f2faa76

How to cite

HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes — arXiv:2611.02752 — arXiv (en), https://arxiv.org/abs/2611.02752 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e5b32f2faa76 (Metraipolis archive dc_e5b32f2faa76, sha256 f5089ec2724f09614ec14e9a192c2e085e9db921c9abb933f02a871886df00f4)
BibTeX
@misc{dce5b32f2faa76,
  title = {HPC-Bench: A Comprehensive Benchmark for High Performance Computing Codes — arXiv:2611.02752},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.02752},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e5b32f2faa76; sha256 f5089ec2724f09614ec14e9a192c2e085e9db921c9abb933f02a871886df00f4},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.02752. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large Language Models (LLMs) have shown strong capabilities in code generation and reasoning, motivating extensive benchmarks for evaluating functional correctness. However, performance optimization in High-Performance Computing (HPC) poses fundamentally different challenges that are not captured by existing evaluations: HPC performance depends on low-level code, intricate memory access patterns, and computational kernels embedded within sophisticated execution contexts. We introduce HPC-Bench, a performance-grounded benchmark for evaluating LLMs as optimizers of computational kernels in realistic HPC workloads, including 114 workloads across 16 HPC computational motifs. HPC-Bench provides a fully automated, end-to-end evaluation pipeline that combines program-level correctness verification with two correctness-gated metrics, Fast@k and Speedup@k, to characterize reliability and speedup under a fixed sampling budget. Our evaluation of three representative LLMs across serial CPU, OpenMP, and CUDA settings shows that stricter speedup requirements substantially reduce the probability of finding a correct and fast optimization. HPC-Bench is available at this https URL .

Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.PF, nuovi lavori del giorno).
Categorie arXiv: Performance (cs.PF).
Pagina del lavoro: https://arxiv.org/abs/2611.02752 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:10:53.310Z dalla pagina https://arxiv.org/list/cs.PF/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).