Metraipolis › archive › dc_113d1bae9bdf
LoRAForge: Co-Designing Post-Hoc Compression and Execution for Efficient Multi-LoRA Serving — arXiv:2611.01256
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.01256
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T18:17:48.284Z
- SHA-256 of the archived text
b58d3813e01cdf20248cbf433717d93318f788ab2e0de8e93acc2ca176d23eb7- Stable URL of this page
https://metraipolis.com/documento/dc_113d1bae9bdf
How to cite
LoRAForge: Co-Designing Post-Hoc Compression and Execution for Efficient Multi-LoRA Serving — arXiv:2611.01256 — arXiv (en), https://arxiv.org/abs/2611.01256 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_113d1bae9bdf (Metraipolis archive dc_113d1bae9bdf, sha256 b58d3813e01cdf20248cbf433717d93318f788ab2e0de8e93acc2ca176d23eb7)
BibTeX
@misc{dc113d1bae9bdf,
title = {LoRAForge: Co-Designing Post-Hoc Compression and Execution for Efficient Multi-LoRA Serving — arXiv:2611.01256},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.01256},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_113d1bae9bdf; sha256 b58d3813e01cdf20248cbf433717d93318f788ab2e0de8e93acc2ca176d23eb7},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01256. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Multi-LoRA serving allows many task-specific adapters to share a common base model, but scaling to large adapter fleets introduces substantial storage, loading, and execution overheads. Post-hoc compression can reduce the memory footprint of trained LoRA adapters, yet smaller ranks do not automatically translate into faster serving. For instance, padding, factor access, and generic kernels can obscure the retained low-rank structure, while independently recompressing thousands of modules also incurs significant preparation overhead. We present LoRAForge, a system connecting batched factor construction to rank-specialized execution through an explicit retained-rank representation. It supports two allocation policies: uniform retention ratios (LoRAForge-U) and spectral-energy budget allocation (LoRAForge-S). Both share FlashTSQR factor construction and the same serving backend. FlashTSQR exploits parallelism across modules and row tiles, accelerating factor construction by up to $2.28\times$ over matched library QR. In a fixed-work Qwen control, the shared runtime adds $1.17$--$1.22\times$ throughput across both compressed policies, with negligible gains on original adapters. Across 85 trained open-weighted Qwen and Llama adapters, the spectral policy's floored quality configuration retains about 7.7% of adapter parameters with fleet-average score drops of at most 1.2 points on a 0--100 scale. The same rank-floored $1/12$ spectral exports achieve substantial token-throughput gains on both AMD and NVIDIA GPUs. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.01256 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T18:09:53.575Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).