Metraipolis › archive › dc_433591c2fbe4

LowRankArena: A Standardized Evaluation Platform for SVD-Based LLM Compression — arXiv:2608.26389

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.26389
License (as archived)
CC0-1.0
Archived
2026-10-17T15:19:22.837Z
SHA-256 of the archived text
6ab224d1a417cf95d3a0320309856296be920d56e55a5ff88b805595400c570f
Stable URL of this page
https://metraipolis.com/documento/dc_433591c2fbe4

How to cite

LowRankArena: A Standardized Evaluation Platform for SVD-Based LLM Compression — arXiv:2608.26389 — arXiv (en), https://arxiv.org/abs/2608.26389 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_433591c2fbe4 (Metraipolis archive dc_433591c2fbe4, sha256 6ab224d1a417cf95d3a0320309856296be920d56e55a5ff88b805595400c570f)
BibTeX
@misc{dc433591c2fbe4,
  title = {LowRankArena: A Standardized Evaluation Platform for SVD-Based LLM Compression — arXiv:2608.26389},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.26389},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_433591c2fbe4; sha256 6ab224d1a417cf95d3a0320309856296be920d56e55a5ff88b805595400c570f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.26389. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

SVD-based low-rank compression has become a fast-growing direction for reducing the memory and computational cost of large language models (LLMs). However, meaningful comparison across existing studies remains difficult as prior evaluations use varied benchmarks, inconsistent ratios, and diverse setups, often failing to isolate low-rank effects from auxiliary techniques. As a result, it remains unclear whether reported gains reflect method-level improvements or differences in evaluation protocol. This lack of comparability highlights the need for a unified, reproducible evaluation platform. To address this problem, we present LowRankArena, a standardized evaluation platform for SVD-based LLM compression. LowRankArena unifies task versions, uniform-precision compression budgets, comparison regimes, and inference measurements, and provides a reproducible pipeline with over 3 TiB released compressed checkpoints. Using LowRankArena, our aligned audit of five representative SVD methods reveals that prior findings are highly conditional under standardized protocols: clear leaders and performance tiers shift across backbones and keep ratios, multiple-choice accuracy can hide large perplexity degradation, and nominal low-rank savings yield workload-dependent and often limited end-to-end speedups. Our code is available at: this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.26389 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T15:15:18.050Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).