Metraipolis › archive › dc_b6ff0fe75eec

Scalability Analysis of Distributed Kolmogorov-Arnold Network Training on High-Performance Computing Systems — arXiv:2609.07740

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.07740
License (as archived)
CC0-1.0
Archived
2026-10-16T13:07:18.070Z
SHA-256 of the archived text
76b34f9269b4fa04f12b3eef76b6bd5b4522c443a7d47a62c1b1e0fb77354080
Stable URL of this page
https://metraipolis.com/documento/dc_b6ff0fe75eec

How to cite

Scalability Analysis of Distributed Kolmogorov-Arnold Network Training on High-Performance Computing Systems — arXiv:2609.07740 — arXiv (en), https://arxiv.org/abs/2609.07740 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b6ff0fe75eec (Metraipolis archive dc_b6ff0fe75eec, sha256 76b34f9269b4fa04f12b3eef76b6bd5b4522c443a7d47a62c1b1e0fb77354080)
BibTeX
@misc{dcb6ff0fe75eec,
  title = {Scalability Analysis of Distributed Kolmogorov-Arnold Network Training on High-Performance Computing Systems — arXiv:2609.07740},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.07740},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b6ff0fe75eec; sha256 76b34f9269b4fa04f12b3eef76b6bd5b4522c443a7d47a62c1b1e0fb77354080},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.07740. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Kolmogorov-Arnold Networks (KANs) replace the fixed activation functions and linear weights of Multi-Layer Perceptrons (MLPs) with learnable univariate functions on network edges, offering improved interpretability and, in some settings, competitive parameter efficiency. While the approximation properties of KANs have received considerable attention, their behavior under distributed, multi-GPU training has not been systematically characterized. This paper presents an empirical scalability study of data-parallel KAN training on multi-node, multi-GPU high-performance computing (HPC) infrastructure, evaluated along four dimensions: strong scaling, weak scaling, communication overhead, and model-size scaling. Experiments were conducted on the FinisTerrae III supercomputer using up to 8 NVIDIA A100 GPUs across 4 nodes with PyTorch Distributed Data Parallel (DDP). KAN training reaches 74.7% parallel efficiency at 8 GPUs with a 5.97x speedup, consistent with conventional deep learning workloads. Weak scaling shows an initial single-to-multi-GPU throughput drop followed by strong stability. Communication overhead follows a non-monotonic pattern (1.3%-6.1%), driven primarily by All-Reduce algorithm selection and inter-node latency rather than KAN's edge-wise gradient structure. The parameter-to-memory ratio improves with model size even as training time scales unfavorably. These results indicate that operator-level and data-parallel optimizations for KAN are complementary. We provide deployment guidelines for GPU topology and model-size selection, and discuss the limitations of a synthetic-regression evaluation.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-09 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC) ; Machine Learning (cs.LG); Performance (cs.PF).
Pagina del lavoro: https://arxiv.org/abs/2609.07740 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T13:02:21.586Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).