Metraipolis › archive › dc_7d349afa40bc

The Other Half of Workflow Portability: Evidence-Backed HPC Site Profiles with Agentic Discovery — arXiv:2610.00971

Source: arXiv (en)
Original: https://arxiv.org/abs/2610.00971
License (as archived): CC0-1.0
Archived: 2026-10-06T14:02:32.856Z
SHA-256 of the archived text: 5986ce4edbb028d6f4ac946530c3ee62c13ef0adc2156fa79900223628d9f79f
Stable URL of this page: https://metraipolis.com/documento/dc_7d349afa40bc

How to cite

The Other Half of Workflow Portability: Evidence-Backed HPC Site Profiles with Agentic Discovery — arXiv:2610.00971 — arXiv (en), https://arxiv.org/abs/2610.00971 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7d349afa40bc (Metraipolis archive dc_7d349afa40bc, sha256 5986ce4edbb028d6f4ac946530c3ee62c13ef0adc2156fa79900223628d9f79f)

BibTeX

@misc{dc7d349afa40bc,
  title = {The Other Half of Workflow Portability: Evidence-Backed HPC Site Profiles with Agentic Discovery — arXiv:2610.00971},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.00971},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7d349afa40bc; sha256 5986ce4edbb028d6f4ac946530c3ee62c13ef0adc2156fa79900223628d9f79f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.00971. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Moving a workflow developed and tested at one HPC site to another rarely succeeds without some amount of trial and error. Package managers rebuild software environments, containers ship whole filesystems, and workflow specifications such as backpacks package a workflow with its software, data, and resource requirements. These approaches address one half of workflow portability: what a workflow needs. But none describes how a given HPC site must be used, and that missing half is why even a portable workflow requires manual adjustment at each new site. That gap includes the site's resource shape, storage configuration, network permissions, and operating policies. This information may be explicit in the batch system, hidden in the prose of documentation, or buried deep within a router's configuration, making it difficult for an automated deployment tool to turn site knowledge into useful deployment decisions. We propose the HPC site profile, a structured, evidence-backed document that makes this knowledge actionable. We automatically construct it in three steps that mirror where the information lives: measuring the login node, extracting typed fields from documentation with a bounded language-model agent, and submitting pilot jobs for eligible unresolved fields. Every field is verified against its evidence or discarded, so a rule, not the model, decides what enters the profile. The profile then preflights a workflow into an execution plan or an early, explainable failure. We build profiles at Purdue Anvil, TACC Stampede3, and Notre Dame CRC and present a case study of preflighting a real workflow.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-10-02 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC) ; Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2610.00971 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T12:22:22.546Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-10-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).