Metraipolis › archive › dc_7374184f1aed

HBFSim: Fast and Faithful Simulation of High-Bandwidth Flash Under Real GPU Execution — arXiv:2609.09800

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.09800
License (as archived)
CC0-1.0
Archived
2026-10-16T07:54:09.519Z
SHA-256 of the archived text
be1cb7195e776c99eaf890838660cc77032b22c5ceccc89a9e5669658a72de1d
Stable URL of this page
https://metraipolis.com/documento/dc_7374184f1aed

How to cite

HBFSim: Fast and Faithful Simulation of High-Bandwidth Flash Under Real GPU Execution — arXiv:2609.09800 — arXiv (en), https://arxiv.org/abs/2609.09800 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7374184f1aed (Metraipolis archive dc_7374184f1aed, sha256 be1cb7195e776c99eaf890838660cc77032b22c5ceccc89a9e5669658a72de1d)
BibTeX
@misc{dc7374184f1aed,
  title = {HBFSim: Fast and Faithful Simulation of High-Bandwidth Flash Under Real GPU Execution — arXiv:2609.09800},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.09800},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7374184f1aed; sha256 be1cb7195e776c99eaf890838660cc77032b22c5ceccc89a9e5669658a72de1d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.09800. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

High-Bandwidth Flash (HBF) places high-capacity NAND beside HBM to relieve the memory-capacity bottleneck of LLM inference, yet its system-level behavior cannot be evaluated before hardware becomes available. Cycle-level GPU simulators are too slow for production-scale models. Trace replay has a further shortcoming: it cannot capture the allocation, migration, and execution changes induced by different HBM-HBF configurations. Our key insight is that HBF need not be evaluated by simulating the GPU: only the program-visible effects of HBF need to be modeled. And only a real LLM workload running on real hardware can answer the arguments about HBF. Hence the modeled service has to be injected into that running program, and the injection must not destroy the GPU concurrency that would hide the original I/O latency. We present HBFSim, an open-source HBF simulator that executes LLM workloads on a real GPU while modeling HBF timing, thermal, and other behaviors online. HBFSim rewrites the PTX of the workload's kernels and routes accesses inside a registered address range into the HBF simulator. It supports asynchronous TMA transfers and capacities beyond physical GPU memory. HBFSim leaves the model's run unaffected across ordinary-memory, TMA, and capacity-mode tests. The delay it injects matches the delay requested to within 0.152%. We also design a coupled thermal module that puts HBF, HBM, and the GPU in one advanced package, which is important for answering how severe the hot throttling problem becomes after HBF runs for a long time. Experiments with Qwen3-30B show how package heating, HBM-HBF allocation, and shared MoE demand jointly constrain the design space of future HBF accelerators. The source code of HBFSim is available at this https URL .

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-10 in cs.AR).
Categorie arXiv: Hardware Architecture (cs.AR) ; Emerging Technologies (cs.ET).
Pagina del lavoro: https://arxiv.org/abs/2609.09800 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T07:25:33.739Z dalla pagina https://arxiv.org/catchup/cs.AR/2026-09-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).