Metraipolis › archive › dc_14ee079df363

Xronos: Heterogeneity-Aware Tensor Parallelism for Collaborative LLM Fine-Tuning on Edge CPUs — arXiv:2609.19909

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.19909
License (as archived)
CC0-1.0
Archived
2026-10-10T03:48:54.868Z
SHA-256 of the archived text
bbf4e41a3f94c056de78b0946b67e53720a952d7bb784c8041202c38746b0398
Stable URL of this page
https://metraipolis.com/documento/dc_14ee079df363

How to cite

Xronos: Heterogeneity-Aware Tensor Parallelism for Collaborative LLM Fine-Tuning on Edge CPUs — arXiv:2609.19909 — arXiv (en), https://arxiv.org/abs/2609.19909 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_14ee079df363 (Metraipolis archive dc_14ee079df363, sha256 bbf4e41a3f94c056de78b0946b67e53720a952d7bb784c8041202c38746b0398)
BibTeX
@misc{dc14ee079df363,
  title = {Xronos: Heterogeneity-Aware Tensor Parallelism for Collaborative LLM Fine-Tuning on Edge CPUs — arXiv:2609.19909},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.19909},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_14ee079df363; sha256 bbf4e41a3f94c056de78b0946b67e53720a952d7bb784c8041202c38746b0398},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.19909. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Collaborative fine-tuning on edge devices adapts large language models to domain-specific data while keeping each device's data local. State-of-the-art (SOTA) collaborative fine-tuning techniques are largely designed for GPU-based edge devices and rely on pipeline parallelism (PP). However, many edge platforms, including IoT gateways, smart-home hubs, and in-vehicle computers, are primarily CPU-based. This paper reports that PP is ineffective on CPU-based edge devices because the same CPU handles both model computation and communication, which causes severe CPU contention. Our analysis shows that this leads to 5.75$\times$ higher computation stall ratios than on GPU devices on average. Tensor parallelism (TP) can alleviate this contention by separating computation and communication, but existing TP techniques assume homogeneous devices. On heterogeneous CPU edge devices, we find that this assumption causes faster workers to remain idle for up to 34% while waiting for slower devices at synchronization points. To address the limitations, we propose Xronos, a collaborative fine-tuning framework for heterogeneous CPU edge devices. Xronos uses TP as its execution backbone and combines lightweight profiling with heterogeneity-aware tensor partitioning to reduce the straggler bottleneck. Across diverse devices, models, and benchmark tasks, Xronos reduces fine-tuning time by 18% (TP) to 56% (PP) and the ratio of device idle time by $\sim$5.9$\times$ over SOTA techniques, while maintaining the accuracy.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-18 in cs.DC).
Categorie arXiv: Distributed, Parallel, and Cluster Computing (cs.DC).
Pagina del lavoro: https://arxiv.org/abs/2609.19909 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-10T03:24:19.916Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).