Metraipolis › archive › dc_15411414fa29
Capability Gain from ISA to Shared Execution on AMD MI300A and MI250X — arXiv:2611.07198
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.07198
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-06T14:43:26.239Z
- SHA-256 of the archived text
823f81a99c89e5ef22dc289bdabd55e389402c69660ca432e9bf497eaa4e7b7d- Stable URL of this page
https://metraipolis.com/documento/dc_15411414fa29
How to cite
Capability Gain from ISA to Shared Execution on AMD MI300A and MI250X — arXiv:2611.07198 — arXiv (en), https://arxiv.org/abs/2611.07198 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_15411414fa29 (Metraipolis archive dc_15411414fa29, sha256 823f81a99c89e5ef22dc289bdabd55e389402c69660ca432e9bf497eaa4e7b7d)
BibTeX
@misc{dc15411414fa29,
title = {Capability Gain from ISA to Shared Execution on AMD MI300A and MI250X — arXiv:2611.07198},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.07198},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_15411414fa29; sha256 823f81a99c89e5ef22dc289bdabd55e389402c69660ca432e9bf497eaa4e7b7d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.07198. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Each new GPU generation is showcased by its peak instruction rates, yet users hardly ever run instructions directly: they reach the hardware's performance through vendor libraries, applications and devices shared with other jobs. How much of a theoretical speedup survives these layers is rarely measured, so a team deciding whether to move to a new generation, or to adopt FP8 or 2:4 sparsity, lacks adequate guidance. AMD's MI300A (CDNA3) adds new FP8 matrix instructions and 2:4 structured-sparse instructions that the predecessor, the MI250X (CDNA2), does not have. We analyze this theoretical speedup gap on AMD's MI300A (CDNA3) against the MI250X (CDNA2) by defining a new metric, capability gain. Capability gain is the fraction of a feature's instruction-level speedup that it keeps at a higher level, such as a library, an application or a shared device. We trace it from ISA microbenchmarks through hipBLASLt and hipSPARSELt to LLM inference and mixed-precision HPL, and onto a device shared by up to eight concurrent streams. FP8 keeps most of its speedup through the library, completing an $8192^3$ GEMM \genCapPkgEndToEndGainEightK{} faster than the MI250X with FP16, but unfused quantization turns it into a per-layer slowdown in an LLM, and 2:4 sparsity keeps at most about half of its speedup in hipSPARSELt. Under queue sharing, FP8's GEMM capability gain rises above 1. How fairly streams share the device depends on the number of hardware queues, not on the numeric precision, yet shared LLM serving gains nothing from FP8.
Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.DC, nuovi lavori del giorno).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC).
Pagina del lavoro: https://arxiv.org/abs/2611.07198 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-06T14:19:12.617Z dalla pagina https://arxiv.org/list/cs.DC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).