Metraipolis › archive › dc_4db9175be986

XMPIaaS: Towards Cloud Native MPI via Cooperative Process Migration — arXiv:2609.16531

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.16531
License (as archived)
CC0-1.0
Archived
2026-10-15T19:29:35.397Z
SHA-256 of the archived text
133bfd883445023ca11cb2e80e73505e215348584379dc6f40674c2150de3829
Stable URL of this page
https://metraipolis.com/documento/dc_4db9175be986

How to cite

XMPIaaS: Towards Cloud Native MPI via Cooperative Process Migration — arXiv:2609.16531 — arXiv (en), https://arxiv.org/abs/2609.16531 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4db9175be986 (Metraipolis archive dc_4db9175be986, sha256 133bfd883445023ca11cb2e80e73505e215348584379dc6f40674c2150de3829)
BibTeX
@misc{dc4db9175be986,
  title = {XMPIaaS: Towards Cloud Native MPI via Cooperative Process Migration — arXiv:2609.16531},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.16531},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4db9175be986; sha256 133bfd883445023ca11cb2e80e73505e215348584379dc6f40674c2150de3829},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.16531. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Message Passing Interface (MPI) has been the dominant programming model for High Performance Computing (HPC) for three decades, and as HPC workloads increasingly migrate to cloud infrastructure for scalability and cost efficiency, MPI applications must contend with an execution environment fundamentally unlike traditional supercomputers: ephemeral resources, dynamic pricing and preemptable instances. In such a volatile setting, the ability to relocate running MPI processes between nodes without restarting the job is a necessity for cost-effective, resilient execution. Existing approaches either require restarting the entire job from a global checkpoint, or transparently intercepting the full MPI stack at prohibitive complexity. To address these challenges, we propose \name, a cooperative migration system for MPI that enables selective process group migration on-the-fly. When a cloud instance is scheduled for preemption, only the affected ranks are relocated while the remaining processes briefly quiesce and resume in place, avoiding the cost of a full-job checkpoint. \name tackles this through a cooperative protocol between the MPI process management runtime and rank processes. We expose an \texttt{XMPI\_quiesce} interface built atop the MPI Sessions API that allows applications to mark safe migration points, and we extend the Hydra process manager to orchestrate the full migration lifecycle: rank quiescence, CRIU checkpoint/restore, proxy relaunch on the target node, and seamless rank reconnection. We evaluate and show that the cooperative quiesce phase accounts for less than 1.4\% of total migration downtime, and that this downtime is governed by the migrating node's rank count alone, independent of job size, and the instrumentation introduces no measurable overhead during normal execution.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-16 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC).
Pagina del lavoro: https://arxiv.org/abs/2609.16531 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T18:35:05.420Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-09-16?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).